-- Logs begin at Tue 2022-08-30 03:31:38 UTC, end at Tue 2022-08-30 04:33:49 UTC. -- Aug 30 04:02:21.098232 dv-cinder-852208-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:02:21 2022] *** Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: nodename: dv-cinder-852208-11-smb Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: machine: x86_64 Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: clock source: unix Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: pcre jit disabled Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: detected number of CPU cores: 4 Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: current working directory: / Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: your processes number limit is 47680 Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: your memory page size is 4096 bytes Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: detected max file descriptor number: 2048 Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: lock engine: pthread robust mutexes Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: thunder lock: enabled Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 04:02:21.113534 dv-cinder-852208-11-smb devstack@keystone.service[81641]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:02:21.149399 dv-cinder-852208-11-smb devstack@keystone.service[81641]: Python main interpreter initialized at 0x562c3bc0c9c0 Aug 30 04:02:21.149399 dv-cinder-852208-11-smb devstack@keystone.service[81641]: python threads support enabled Aug 30 04:02:21.149399 dv-cinder-852208-11-smb devstack@keystone.service[81641]: your server socket listen backlog is limited to 100 connections Aug 30 04:02:21.149399 dv-cinder-852208-11-smb devstack@keystone.service[81641]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:02:21.149804 dv-cinder-852208-11-smb devstack@keystone.service[81641]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:02:21.149885 dv-cinder-852208-11-smb devstack@keystone.service[81641]: *** Operational MODE: preforking *** Aug 30 04:02:21.150113 dv-cinder-852208-11-smb devstack@keystone.service[81641]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:02:21.150113 dv-cinder-852208-11-smb devstack@keystone.service[81641]: spawned uWSGI master process (pid: 81641) Aug 30 04:02:21.150318 dv-cinder-852208-11-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 04:02:21.151281 dv-cinder-852208-11-smb devstack@keystone.service[81641]: spawned uWSGI worker 1 (pid: 81656, cores: 1) Aug 30 04:02:21.151281 dv-cinder-852208-11-smb devstack@keystone.service[81641]: spawned uWSGI worker 2 (pid: 81657, cores: 1) Aug 30 04:02:21.151424 dv-cinder-852208-11-smb devstack@keystone.service[81641]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:02:25.418337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:02:25.418337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: from cryptography.utils import int_from_bytes Aug 30 04:02:25.419189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:02:25.419189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: from cryptography.utils import int_from_bytes Aug 30 04:02:25.421007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:02:25.421007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: from cryptography.utils import int_from_bytes Aug 30 04:02:25.421463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:02:25.421463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: from cryptography.utils import int_from_bytes Aug 30 04:02:25.468096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:02:25.468287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:02:25.468475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] command line args: [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:02:25.469395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:02:25.469592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ================================================================================ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:02:25.469846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] admin_token = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.470086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config_dir = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.470269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.470446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] config_source = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.470620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] debug = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.470816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.471122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:02:25.471215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.471320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:02:25.471394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.471502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] command line args: [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:02:25.471574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.471756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:02:25.471844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.471942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ================================================================================ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:02:25.472052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_config_append = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] admin_token = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config_dir = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_dir = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] config_source = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.472988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] debug = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.473999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_config_append = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_dir = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.474920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.475938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] publish_errors = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.476982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] standard_threads = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.477948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478509 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_journal = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478840 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_json = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] publish_errors = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.478995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_stderr = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.479072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.479151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] use_syslog = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.479304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.479382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.479483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.479610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.479731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.479863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.479967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.480085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.480202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] standard_threads = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.480320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.480432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.480565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.480676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.480798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.480876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.481013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_journal = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.481095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.481178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_json = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.481250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.481348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_stderr = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.481489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.481598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] use_syslog = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.481756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.481843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:02:25.482001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.482950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483028 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.483991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.484984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.485916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.486998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.487936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.488941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.489861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.490936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.491907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.492972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.493900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.494880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.495960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.496958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.497931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.498901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.499955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.500975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.501913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.502964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.503983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.external = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.504886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505519 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.password = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] auth.token = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.505996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.506928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.external = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.507929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.password = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] auth.token = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.508878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.509987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.510962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511199 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.511977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.512910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.513898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514601 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.514984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.515070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.515216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.515295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.515455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.516992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.517923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.518855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.519964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.520966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.521942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.522867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.523946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.524970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.525906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.526973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.527989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528459 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.528914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.529853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.530945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.531025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.531216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.531823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.531977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.532990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.533949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.534885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.535848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.536966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.537931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.538943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.539894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.540975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.541954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.542929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.543865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.544944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.545025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.545604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.545676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.545739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.545799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.545885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.545962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.546933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.547114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.547234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.547342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.547573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.547652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.547822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.547960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.548076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.548325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.548449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.548560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.548645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.548795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.548888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.549996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.550966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.551999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552477 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.552940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.553906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.554991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.555997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.556071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:02:25.556152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.556380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.556629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.556862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.557102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.557329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.557600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.557835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:02:25.558003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:02:25.586098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.586620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.586794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.587701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.587932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.588156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.595226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.596758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.623032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.623254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.624672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.625398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.681197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.682244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.730457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.730684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.731253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.731485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.885693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.885920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.886137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.886352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.886465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.886570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.886654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.886783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.886867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.887000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.887217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.887432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.910140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.910370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.910594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.910745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.910878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.911794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.912042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.922991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.923567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.935597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.935758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.935983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.936126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.936258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.936398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.936528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.936655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.936791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.936919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.937046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81657) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.937173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.937173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.937421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 04:02:25.956365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.956607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:02:25.956904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.957102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:02:25.957379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.957676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.957811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.957983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:02:25.958208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.958404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.958548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.958677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 04:02:25.958884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.959144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.959400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.959653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.969838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.970113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.970383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.970600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.970741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.970892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.971139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.971418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.977473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:25.978392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:25.980494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:25.980776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.981057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.981257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:25.981386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.981548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.981688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.981845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.981978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.982109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.982248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.982389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.982520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.982650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.982781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.982910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.983048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.983179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.983309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.983524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.983801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:25.984070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.006899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.007675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.008342 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.008625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.009125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.009409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.013117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.013401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.013711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.014071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.014355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.014635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.020192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.020472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.020983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.021271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.024466 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.024813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.025120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.025337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.025480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.025651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.025733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.025924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.026008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.026205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.026296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.026483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.026758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.027029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.027298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.028190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.043761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.044036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.044307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.044587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.048410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.048988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.051516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.051813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.052227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.052524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.056153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.056752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.059308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.059899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.062435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.063256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.063538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.063720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.063803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.064036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.064128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.064324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.064408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.064607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.064886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.065166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.080243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.080531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.080799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.081061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.081154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.081351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.081646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.081914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.088045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.089043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.089583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.090610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.091225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.091501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.092153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.092431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.094193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.094476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.094764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.095045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.095126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.095330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.095415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.095776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.096080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.096363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.106597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.106882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.107163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.107441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.107579 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.107718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.107863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.107994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.108247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.108347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.108532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.108814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.109103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.109926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.124118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.125902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.127618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.128830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.130601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.131731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.132028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.133167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.133478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.133780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.134079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.134800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.135092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.135375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.140800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.141847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.142308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.143319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.145162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.145448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.145750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.146021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.146338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.146640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.146925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.147201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.153920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.154210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.154480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.155012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.155303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.155582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.161266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81657) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.161672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.161955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.162231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.162504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.162584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 04:02:26.162777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.162873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.163959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.164148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.164231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.164416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.164497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.164677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.164804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.164945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.165027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81657) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.165223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.165484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.165771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.166046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 04:02:26.199706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c3bc0c9c0 pid: 81657 (default app) Aug 30 04:02:26.200989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c3bc0c9c0 pid: 81656 (default app) Aug 30 04:02:26.203077 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45227656-a77a-4300-bc1c-a30d11f1273a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:26.203366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45227656-a77a-4300-bc1c-a30d11f1273a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:26.203635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45227656-a77a-4300-bc1c-a30d11f1273a None None] PATH_INFO: `/v3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:26.207814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Tue Aug 30 04:02:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:32.792715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789aae0-04c9-4262-98c3-95aaf7eec385 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:32.793232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789aae0-04c9-4262-98c3-95aaf7eec385 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:32.793232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789aae0-04c9-4262-98c3-95aaf7eec385 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:32.798085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:32.803277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924519-d888-47c8-97dc-de5305458a7a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:32.803799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924519-d888-47c8-97dc-de5305458a7a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:32.803799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924519-d888-47c8-97dc-de5305458a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:32.874175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: INFO dbcounter [None req-94924519-d888-47c8-97dc-de5305458a7a None None] Registered counter for database keystone Aug 30 04:02:32.893392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG oslo_db.sqlalchemy.engines [None req-94924519-d888-47c8-97dc-de5305458a7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:02:32.899668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writer thread running {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:02:33.077399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG passlib.handlers.bcrypt [None req-94924519-d888-47c8-97dc-de5305458a7a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81657) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 04:02:33.077809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG passlib.handlers.bcrypt [None req-94924519-d888-47c8-97dc-de5305458a7a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81657) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 04:02:33.135712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-94924519-d888-47c8-97dc-de5305458a7a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:33.137223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-94924519-d888-47c8-97dc-de5305458a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:33.263627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 04:02:33.736692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789aae0-04c9-4262-98c3-95aaf7eec385 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:33.806040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: INFO dbcounter [None req-1789aae0-04c9-4262-98c3-95aaf7eec385 None None] Registered counter for database keystone Aug 30 04:02:33.827208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG oslo_db.sqlalchemy.engines [None req-1789aae0-04c9-4262-98c3-95aaf7eec385 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:02:33.834064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writer thread running {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:02:33.951773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789aae0-04c9-4262-98c3-95aaf7eec385 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:33.956479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c3cf-3248-42d8-be03-31c59fbac6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:33.957096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c3cf-3248-42d8-be03-31c59fbac6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:33.957372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c3cf-3248-42d8-be03-31c59fbac6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:33.957671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c3cf-3248-42d8-be03-31c59fbac6e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:33.966044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c3cf-3248-42d8-be03-31c59fbac6e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:34.018106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING keystone.common.rbac_enforcer.enforcer [None req-de66c3cf-3248-42d8-be03-31c59fbac6e1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 04:02:34.018437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c3cf-3248-42d8-be03-31c59fbac6e1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:34.027718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Tue Aug 30 04:02:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:34.033792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94924519-d888-47c8-97dc-de5305458a7a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:34.048039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94924519-d888-47c8-97dc-de5305458a7a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:34.052464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e4b09-3d45-4ccb-9a5d-ca98477dda75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:34.053579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4b09-3d45-4ccb-9a5d-ca98477dda75 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:34.053865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4b09-3d45-4ccb-9a5d-ca98477dda75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:34.054138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e4b09-3d45-4ccb-9a5d-ca98477dda75 admin admin] PATH_INFO: `/v3/projects/182d1898255a432ebd2d97be00a98e9d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:34.055701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e4b09-3d45-4ccb-9a5d-ca98477dda75 admin admin] RBAC: Authorizing `identity:get_project(project_id=182d1898255a432ebd2d97be00a98e9d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:34.108835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a59e4b09-3d45-4ccb-9a5d-ca98477dda75 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 04:02:34.109175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e4b09-3d45-4ccb-9a5d-ca98477dda75 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:34.113727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Tue Aug 30 04:02:34 2022] GET /identity/v3/projects/182d1898255a432ebd2d97be00a98e9d => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:35.992652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2419fc-b758-47e1-8536-877c8d3efdb7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:35.993172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2419fc-b758-47e1-8536-877c8d3efdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:35.993172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2419fc-b758-47e1-8536-877c8d3efdb7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:35.997221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:36.002607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5190e8-e109-4feb-b028-17b85903d4dd None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:36.002998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5190e8-e109-4feb-b028-17b85903d4dd None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:36.003156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5190e8-e109-4feb-b028-17b85903d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:36.023426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0e5190e8-e109-4feb-b028-17b85903d4dd None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:36.024926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0e5190e8-e109-4feb-b028-17b85903d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:36.033260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 04:02:36.301698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2419fc-b758-47e1-8536-877c8d3efdb7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:36.313721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2419fc-b758-47e1-8536-877c8d3efdb7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:36.317973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658d865-cadf-4a7b-aeb5-e9596b0db97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:36.318568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d865-cadf-4a7b-aeb5-e9596b0db97e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:36.318845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d865-cadf-4a7b-aeb5-e9596b0db97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:36.319113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d865-cadf-4a7b-aeb5-e9596b0db97e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:36.326661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658d865-cadf-4a7b-aeb5-e9596b0db97e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:36.328414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658d865-cadf-4a7b-aeb5-e9596b0db97e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:36.337289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Tue Aug 30 04:02:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:02:36.342555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5190e8-e109-4feb-b028-17b85903d4dd None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:36.352134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5190e8-e109-4feb-b028-17b85903d4dd None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:36.356462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b79bf0-3e87-4f29-8f4b-b5d322d00322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:36.357080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b79bf0-3e87-4f29-8f4b-b5d322d00322 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:36.357359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b79bf0-3e87-4f29-8f4b-b5d322d00322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:36.357679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b79bf0-3e87-4f29-8f4b-b5d322d00322 admin admin] PATH_INFO: `/v3/users/6cce99ec4d5640fbb0998973ffaa1781` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:36.358989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b79bf0-3e87-4f29-8f4b-b5d322d00322 admin admin] RBAC: Authorizing `identity:get_user(user_id=6cce99ec4d5640fbb0998973ffaa1781)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:36.361427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b79bf0-3e87-4f29-8f4b-b5d322d00322 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:36.362976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Tue Aug 30 04:02:36 2022] GET /identity/v3/users/6cce99ec4d5640fbb0998973ffaa1781 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:38.326108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce4e1-5b3a-42cc-802d-dc030a8b0e35 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:38.326666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce4e1-5b3a-42cc-802d-dc030a8b0e35 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:38.326666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce4e1-5b3a-42cc-802d-dc030a8b0e35 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:38.327956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:38.333114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e9d6-452f-49d9-b82d-3fa841212178 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:38.333548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e9d6-452f-49d9-b82d-3fa841212178 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:38.333685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e9d6-452f-49d9-b82d-3fa841212178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:38.352030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fdf6e9d6-452f-49d9-b82d-3fa841212178 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:38.353248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fdf6e9d6-452f-49d9-b82d-3fa841212178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:38.353892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcfd2-336f-4b35-88a5-5b393fa90e3e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:38.354182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcfd2-336f-4b35-88a5-5b393fa90e3e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:38.354462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcfd2-336f-4b35-88a5-5b393fa90e3e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:38.355764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:38.361371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:38.361694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:38.361967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:38.402797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG passlib.handlers.bcrypt [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81656) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 04:02:38.403185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG passlib.handlers.bcrypt [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81656) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 04:02:38.433888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:38.452557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:38.454206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:38.553522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:38.704319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e9d6-452f-49d9-b82d-3fa841212178 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:38.729049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:38.807547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e9d6-452f-49d9-b82d-3fa841212178 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:38.829751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:38.840457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:38.841032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:38.841309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:38.841610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:38.853177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:38.862035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:38.863011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:02:38.864072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 7/14] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:38.868905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:38.929146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e905c0-8ea6-4c79-8471-9015a2b71450 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:38.932137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:38.950188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:38.968056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad969-0020-4947-9372-766850130854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:38.969427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad969-0020-4947-9372-766850130854 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:38.969704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77367196-30cb-4ea7-8f4b-bf588eacc9d5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:38.969809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad969-0020-4947-9372-766850130854 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:38.970003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad969-0020-4947-9372-766850130854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:39.003935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:39.004553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:39.004853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:39.005091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:39.005810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:39.006111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:39.007496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:39.025967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 8/15] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:39.027109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:39.047543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad969-0020-4947-9372-766850130854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:39.049072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ad969-0020-4947-9372-766850130854 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:39.124539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c2fbe-7979-4e23-8a38-ed5d1c818ce9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:39.153547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:02:39.159006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad969-0020-4947-9372-766850130854 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:39.162131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:39.165566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:39.166257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:39.166536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:39.166808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] PATH_INFO: `/v3/users/6cce99ec4d5640fbb0998973ffaa1781` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:39.167966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] RBAC: Authorizing `identity:get_user(user_id=6cce99ec4d5640fbb0998973ffaa1781)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:39.169729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:39.171063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 9/17] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:39 2022] GET /identity/v3/users/6cce99ec4d5640fbb0998973ffaa1781 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:39.176494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:39.191241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:39.258320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad969-0020-4947-9372-766850130854 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:39.275522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d3e46-4e95-46c8-8b8f-aadf5bd54b1b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:39.291209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:39.292053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:39.292322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:39.292584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:39.309964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:39.310183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:39.310612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:39.310891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:39.311158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:39.311659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:39.312270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:39.314215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:39.315922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 10/18] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:39.321540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:02:39.331306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:39.332680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:02:39.333714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:02:39.333714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:02:39.333714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:02:39.333714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 9/19] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:39.346058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:39.404013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:39.412731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:39.432079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e82d-7572-46a9-8709-5bd69e7b5d19 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:39.448257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb28e58-ba43-4553-b85a-439dfec367db None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:39.465682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1397b-9251-4c3b-be5f-e6d1db83f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:39.466291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1397b-9251-4c3b-be5f-e6d1db83f162 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:39.466569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1397b-9251-4c3b-be5f-e6d1db83f162 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:39.466845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1397b-9251-4c3b-be5f-e6d1db83f162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:39.467565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1397b-9251-4c3b-be5f-e6d1db83f162 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.domain.id=default, user.id=6cce99ec4d5640fbb0998973ffaa1781) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:39.467868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1397b-9251-4c3b-be5f-e6d1db83f162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:39.469560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1397b-9251-4c3b-be5f-e6d1db83f162 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:39.478401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 11/20] 10.222.0.69 () {56 vars in 1322 bytes} [Tue Aug 30 04:02:39 2022] GET /identity/v3/role_assignments?user.id=6cce99ec4d5640fbb0998973ffaa1781&scope.domain.id=default&role.id=108991f8e3774559b4def1c3448e020b => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:39.483402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5f7e-d954-422b-ba1b-fdc3a4ddb42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:39.484032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5f7e-d954-422b-ba1b-fdc3a4ddb42b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:39.484841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5f7e-d954-422b-ba1b-fdc3a4ddb42b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:39.485249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5f7e-d954-422b-ba1b-fdc3a4ddb42b None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:39.486301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5f7e-d954-422b-ba1b-fdc3a4ddb42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:39.486612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5f7e-d954-422b-ba1b-fdc3a4ddb42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:39.488034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5f7e-d954-422b-ba1b-fdc3a4ddb42b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:39.508231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 10/21] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:41.530872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e156b4-b95a-4719-8d6d-f3bd3cbc886a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:41.531945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e156b4-b95a-4719-8d6d-f3bd3cbc886a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:41.532415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e156b4-b95a-4719-8d6d-f3bd3cbc886a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:41.533979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 12/22] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:41.539576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6d23-024b-4841-8e72-69e3b91e80f8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:41.540383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6d23-024b-4841-8e72-69e3b91e80f8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:41.540859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6d23-024b-4841-8e72-69e3b91e80f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:41.561969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f7bf6d23-024b-4841-8e72-69e3b91e80f8 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:41.563994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f7bf6d23-024b-4841-8e72-69e3b91e80f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:41.595785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9a20-22a6-4f86-863d-d97cf45e7e5b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:41.596037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9a20-22a6-4f86-863d-d97cf45e7e5b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:41.596305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9a20-22a6-4f86-863d-d97cf45e7e5b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:41.597659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 13/23] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:41.604927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d6714-62cf-48b8-afdc-221d44bf1fc3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:41.605200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d6714-62cf-48b8-afdc-221d44bf1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:41.605465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d6714-62cf-48b8-afdc-221d44bf1fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:41.630775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-731d6714-62cf-48b8-afdc-221d44bf1fc3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:41.632214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-731d6714-62cf-48b8-afdc-221d44bf1fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:41.681216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 11/24] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:41.725231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 14/25] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:42.030136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68de26-8aa7-47d1-aa63-b0564b6536e7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.031036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68de26-8aa7-47d1-aa63-b0564b6536e7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.031828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68de26-8aa7-47d1-aa63-b0564b6536e7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.033360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 12/26] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:42.034645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d6714-62cf-48b8-afdc-221d44bf1fc3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:42.039709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43d93-720d-4c45-9506-b77a685bd7b3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.040245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43d93-720d-4c45-9506-b77a685bd7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.040726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c43d93-720d-4c45-9506-b77a685bd7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.077015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c9c43d93-720d-4c45-9506-b77a685bd7b3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:42.079234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c9c43d93-720d-4c45-9506-b77a685bd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:42.183843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:42.197418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:42.233212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d6714-62cf-48b8-afdc-221d44bf1fc3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:42.247724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 13/27] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:42.248590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43d93-720d-4c45-9506-b77a685bd7b3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:42.272211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:42.273189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.273726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.274184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.286881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:42.292193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:42.293015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:42.293832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:02:42.296235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 15/28] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:42.306476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:42.450988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c43d93-720d-4c45-9506-b77a685bd7b3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:42.493700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377bedc-d7d0-42c7-875d-d54e910d04c8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:42.521606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:42.522246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.522520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.522791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.548145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:42.548720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:42.549200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.549445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.549645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:42.549737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.550387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:42.550681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:42.552034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:42.557809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:42.570722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 16/29] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:02:42.573941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:42.575530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:02:42.576338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:02:42.576338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:02:42.576338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:02:42.576338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 14/30] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:42.580909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:42.582158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:42.632894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:42.722862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d91468-c7d6-46e0-a72f-dd12b098a023 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:42.740405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9c89-ae7b-4ecb-b516-8824e2443ca8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:42.765048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aacfe1-f5ac-43be-85b8-4ebcba803481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:42.766108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aacfe1-f5ac-43be-85b8-4ebcba803481 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.766659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aacfe1-f5ac-43be-85b8-4ebcba803481 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.767102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aacfe1-f5ac-43be-85b8-4ebcba803481 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.767936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aacfe1-f5ac-43be-85b8-4ebcba803481 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:42.769745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aacfe1-f5ac-43be-85b8-4ebcba803481 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:42.777784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:42.778446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.778761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.779011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] PATH_INFO: `/v3/users/6cce99ec4d5640fbb0998973ffaa1781` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.780474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] RBAC: Authorizing `identity:get_user(user_id=6cce99ec4d5640fbb0998973ffaa1781)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:42.782821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:42.784675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 17/31] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:42 2022] GET /identity/v3/users/6cce99ec4d5640fbb0998973ffaa1781 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:42.785757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:42.851695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:42.890608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e62d-b445-49fe-a9d0-f08e4e0e7fcc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:42.912640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 15/32] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 30 04:02:42 2022] POST /identity/v3/roles => generated 219 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:02:42.914742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582feca-6cab-48ac-bbc7-fd14e380702e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.915240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582feca-6cab-48ac-bbc7-fd14e380702e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.915754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582feca-6cab-48ac-bbc7-fd14e380702e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.917611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:42.918649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582feca-6cab-48ac-bbc7-fd14e380702e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:42.928166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa851e2-2735-4750-a18f-d8c6017751e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:42.929028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa851e2-2735-4750-a18f-d8c6017751e5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.929438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa851e2-2735-4750-a18f-d8c6017751e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.929871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa851e2-2735-4750-a18f-d8c6017751e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.930681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa851e2-2735-4750-a18f-d8c6017751e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:42.931127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa851e2-2735-4750-a18f-d8c6017751e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:42.933097 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa851e2-2735-4750-a18f-d8c6017751e5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:42.957053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 18/34] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:42.959137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef75e0-7b68-4f3b-9aea-e847d3380af7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:42.959780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef75e0-7b68-4f3b-9aea-e847d3380af7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:42.960300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef75e0-7b68-4f3b-9aea-e847d3380af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:42.985532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-89ef75e0-7b68-4f3b-9aea-e847d3380af7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:42.987035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-89ef75e0-7b68-4f3b-9aea-e847d3380af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:43.028006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:43.043999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582feca-6cab-48ac-bbc7-fd14e380702e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:43.081153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 19/35] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:43.082033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef75e0-7b68-4f3b-9aea-e847d3380af7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:43.088349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:43.089350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.090247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.090804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.094317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:43.096819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:43.099398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 17/36] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:43.110143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:43.150904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:43.202071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef75e0-7b68-4f3b-9aea-e847d3380af7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:43.242712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:43.243658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.244215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.245181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.246516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:43.248393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:43.258604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4768c90-cf33-47ab-90ee-a39b54916e2e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:43.318341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97729e-9bfb-41fe-88f4-85e9bb53d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:43.319002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97729e-9bfb-41fe-88f4-85e9bb53d2e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.319284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97729e-9bfb-41fe-88f4-85e9bb53d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.319560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97729e-9bfb-41fe-88f4-85e9bb53d2e7 None admin] PATH_INFO: `/v3/domains/default/users/6cce99ec4d5640fbb0998973ffaa1781/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.322905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97729e-9bfb-41fe-88f4-85e9bb53d2e7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6cce99ec4d5640fbb0998973ffaa1781, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:43.324706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97729e-9bfb-41fe-88f4-85e9bb53d2e7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:43.349541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 18/37] 10.222.0.69 () {58 vars in 1361 bytes} [Tue Aug 30 04:02:43 2022] PUT /identity/v3/domains/default/users/6cce99ec4d5640fbb0998973ffaa1781/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:02:43.349541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234391-f0dd-4eb7-b5f9-84de71d10150 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.349541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234391-f0dd-4eb7-b5f9-84de71d10150 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.349541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51234391-f0dd-4eb7-b5f9-84de71d10150 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.349541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 19/38] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:43.355707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc14b-ce0d-48eb-a1ef-ba5aa2d5d459 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.356040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc14b-ce0d-48eb-a1ef-ba5aa2d5d459 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.356347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc14b-ce0d-48eb-a1ef-ba5aa2d5d459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.393503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-969cc14b-ce0d-48eb-a1ef-ba5aa2d5d459 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:43.395241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-969cc14b-ce0d-48eb-a1ef-ba5aa2d5d459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:43.411329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:43.460844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 20/39] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:02:43 2022] POST /identity/v3/projects => generated 301 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:43.482518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 20/40] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:43.511453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:43.760036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdef02-1e1a-4e2c-9bbc-840e9502d895 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:43.767648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:43.797975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ace60-7ab1-4e41-9798-a4e045ea2e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:43.798649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ace60-7ab1-4e41-9798-a4e045ea2e1c None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.798931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ace60-7ab1-4e41-9798-a4e045ea2e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.799203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ace60-7ab1-4e41-9798-a4e045ea2e1c None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.799891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ace60-7ab1-4e41-9798-a4e045ea2e1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:43.801403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ace60-7ab1-4e41-9798-a4e045ea2e1c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:43.816903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc14b-ce0d-48eb-a1ef-ba5aa2d5d459 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:43.822970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 21/41] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 30 04:02:43 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:43.862933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75beaa-7da8-493d-9946-bbcbbbd0ee3d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.863802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75beaa-7da8-493d-9946-bbcbbbd0ee3d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.864291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75beaa-7da8-493d-9946-bbcbbbd0ee3d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.866776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 22/42] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:43.873301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef762-e261-4c24-9d6d-4427dd555f61 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.873627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef762-e261-4c24-9d6d-4427dd555f61 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.873905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef762-e261-4c24-9d6d-4427dd555f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.894373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b74ef762-e261-4c24-9d6d-4427dd555f61 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:43.895952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b74ef762-e261-4c24-9d6d-4427dd555f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:43.950988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc14b-ce0d-48eb-a1ef-ba5aa2d5d459 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:43.974139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 23/43] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:43.991130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:43.992116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:43.992597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:43.993071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:43.994045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:43.995658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:44.014812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 21/44] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 30 04:02:43 2022] POST /identity/v3/roles => generated 223 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:44.247889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef762-e261-4c24-9d6d-4427dd555f61 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:44.340655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:44.348827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef762-e261-4c24-9d6d-4427dd555f61 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:44.390937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e1ba-0448-4fb1-b632-e4b2f38cf0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:44.391583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e1ba-0448-4fb1-b632-e4b2f38cf0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:44.391866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e1ba-0448-4fb1-b632-e4b2f38cf0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:44.392203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e1ba-0448-4fb1-b632-e4b2f38cf0e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:44.393268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e1ba-0448-4fb1-b632-e4b2f38cf0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:44.394771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e1ba-0448-4fb1-b632-e4b2f38cf0e9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:44.396352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 24/45] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:44.401920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:44.411570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:44.506614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a842ee9-eae0-45a6-9510-28efa4cb4d4c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:44.539336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bbff4-3e6e-463c-b63f-73ff82eb902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:44.539951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbff4-3e6e-463c-b63f-73ff82eb902e None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:44.540232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbff4-3e6e-463c-b63f-73ff82eb902e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:44.540507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbff4-3e6e-463c-b63f-73ff82eb902e None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:44.541165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bbff4-3e6e-463c-b63f-73ff82eb902e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:44.542633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bbff4-3e6e-463c-b63f-73ff82eb902e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:44.572833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 22/46] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:02:44 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:45.471481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619772eb-0a9b-4b77-be9b-145ffe2bdeef None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:45.471996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619772eb-0a9b-4b77-be9b-145ffe2bdeef None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:45.471996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619772eb-0a9b-4b77-be9b-145ffe2bdeef None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:45.473362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 25/47] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:45.478511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467179-4741-4140-b2c1-9f6254ae8175 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:45.478918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467179-4741-4140-b2c1-9f6254ae8175 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:45.479160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467179-4741-4140-b2c1-9f6254ae8175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:45.496867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-25467179-4741-4140-b2c1-9f6254ae8175 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:45.498102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-25467179-4741-4140-b2c1-9f6254ae8175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:45.552858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:45.568479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 23/48] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:45.833879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619772eb-0a9b-4b77-be9b-145ffe2bdeef None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:45.933327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619772eb-0a9b-4b77-be9b-145ffe2bdeef None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:45.967149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:45.967773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:45.968055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:45.968327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:45.979018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:45.983884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:45.985325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:02:45.986125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 26/49] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:45.991525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25467179-4741-4140-b2c1-9f6254ae8175 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:46.086175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25467179-4741-4140-b2c1-9f6254ae8175 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:46.120351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:46.120957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:46.121238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:46.121533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:46.122210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:46.122512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:46.123891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:46.135551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 24/50] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:46.142206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:46.167731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:46.243637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43fe53-6e36-4273-b599-6b509a71bb66 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:46.278101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:46.278730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:46.279010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:46.279283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] PATH_INFO: `/v3/users/6cce99ec4d5640fbb0998973ffaa1781` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:46.280408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] RBAC: Authorizing `identity:get_user(user_id=6cce99ec4d5640fbb0998973ffaa1781)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:46.282550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:46.284300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 27/51] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:46 2022] GET /identity/v3/users/6cce99ec4d5640fbb0998973ffaa1781 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:02:46.289893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:46.339322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:46.387973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67243-05e1-4ef0-b241-a1fbf6b2f9cb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:46.422760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491bc5a-d1d1-4f51-9e05-0e63c8e8b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:46.423386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491bc5a-d1d1-4f51-9e05-0e63c8e8b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:46.423668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491bc5a-d1d1-4f51-9e05-0e63c8e8b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:46.423939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491bc5a-d1d1-4f51-9e05-0e63c8e8b2f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:46.425054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491bc5a-d1d1-4f51-9e05-0e63c8e8b2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:46.426514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491bc5a-d1d1-4f51-9e05-0e63c8e8b2f2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:46.428074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 25/52] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:46.433938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:46.472324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6b4c-e248-45cd-8292-239eb230820b None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:46.472609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6b4c-e248-45cd-8292-239eb230820b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:46.472888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6b4c-e248-45cd-8292-239eb230820b None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:46.474258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 26/53] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:46.479062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a88c8-f64b-4a94-a945-c2de60b4c28a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:46.479596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a88c8-f64b-4a94-a945-c2de60b4c28a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:46.479596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a88c8-f64b-4a94-a945-c2de60b4c28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:46.529661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:46.540428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4e4c-eee5-49da-bec7-f380b06ecf24 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:46.580855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:46.581493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:46.581800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:46.582071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:46.582863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.domain.id=default, user.id=6cce99ec4d5640fbb0998973ffaa1781) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:46.583148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:46.585337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:46.593595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 28/54] 10.222.0.69 () {56 vars in 1322 bytes} [Tue Aug 30 04:02:46 2022] GET /identity/v3/role_assignments?user.id=6cce99ec4d5640fbb0998973ffaa1781&scope.domain.id=default&role.id=108991f8e3774559b4def1c3448e020b => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:46.603334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-792a88c8-f64b-4a94-a945-c2de60b4c28a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:46.604588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-792a88c8-f64b-4a94-a945-c2de60b4c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:46.677537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 27/55] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:46.949457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:47.046710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3f809-c79d-451a-b176-4baeff298843 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:47.079649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c4f30-8346-4f7b-89b0-ecb67a1a1ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:47.080267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4f30-8346-4f7b-89b0-ecb67a1a1ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:47.080546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4f30-8346-4f7b-89b0-ecb67a1a1ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:47.080818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c4f30-8346-4f7b-89b0-ecb67a1a1ea6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:47.081943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c4f30-8346-4f7b-89b0-ecb67a1a1ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:47.083387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c4f30-8346-4f7b-89b0-ecb67a1a1ea6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:47.084939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 29/56] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:47.090678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a88c8-f64b-4a94-a945-c2de60b4c28a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:47.137996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:47.188135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a88c8-f64b-4a94-a945-c2de60b4c28a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:47.221254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c9a7-c674-4eee-839e-b3456be37218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:47.221815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c9a7-c674-4eee-839e-b3456be37218 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:47.222092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c9a7-c674-4eee-839e-b3456be37218 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:47.222362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c9a7-c674-4eee-839e-b3456be37218 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:47.223007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c9a7-c674-4eee-839e-b3456be37218 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:47.224424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c9a7-c674-4eee-839e-b3456be37218 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:47.249194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 28/57] 10.222.0.69 () {60 vars in 1140 bytes} [Tue Aug 30 04:02:47 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:49.136822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbce5-7833-44d4-bf61-1367bd0d6209 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:49.137349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbce5-7833-44d4-bf61-1367bd0d6209 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:49.137447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbce5-7833-44d4-bf61-1367bd0d6209 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:49.138774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 30/58] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:49.144494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85de15-95f8-4582-99f7-0837b1d646f3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:49.144856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85de15-95f8-4582-99f7-0837b1d646f3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:49.145050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85de15-95f8-4582-99f7-0837b1d646f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:49.162734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7c85de15-95f8-4582-99f7-0837b1d646f3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:49.163923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7c85de15-95f8-4582-99f7-0837b1d646f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:49.228089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 29/59] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:49.494833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbce5-7833-44d4-bf61-1367bd0d6209 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:49.520009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:49.599455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbce5-7833-44d4-bf61-1367bd0d6209 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:49.633260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77593ad0-f7bf-4cd9-aa9e-4b1cd75d3394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:49.633900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593ad0-f7bf-4cd9-aa9e-4b1cd75d3394 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:49.634177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593ad0-f7bf-4cd9-aa9e-4b1cd75d3394 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:49.634447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593ad0-f7bf-4cd9-aa9e-4b1cd75d3394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:49.635544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77593ad0-f7bf-4cd9-aa9e-4b1cd75d3394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:49.636966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77593ad0-f7bf-4cd9-aa9e-4b1cd75d3394 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:49.638541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 31/60] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:49.644011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85de15-95f8-4582-99f7-0837b1d646f3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:49.673924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:49.742708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85de15-95f8-4582-99f7-0837b1d646f3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:49.774721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e143d-36bc-48fe-80da-18dd83b0ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:49.775265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e143d-36bc-48fe-80da-18dd83b0ffc4 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:49.775544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e143d-36bc-48fe-80da-18dd83b0ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:49.775818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e143d-36bc-48fe-80da-18dd83b0ffc4 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:49.776504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e143d-36bc-48fe-80da-18dd83b0ffc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:49.777997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e143d-36bc-48fe-80da-18dd83b0ffc4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:49.804688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 30/61] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:02:49 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:52.866228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd0ab-cd46-4b7e-8c4d-3ca2cfb75068 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:52.867222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd0ab-cd46-4b7e-8c4d-3ca2cfb75068 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:52.867703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd0ab-cd46-4b7e-8c4d-3ca2cfb75068 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:52.869267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 32/62] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:52.874408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9c27e-59ee-4631-9201-e584c2ec0af6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:52.874831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9c27e-59ee-4631-9201-e584c2ec0af6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:52.874955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9c27e-59ee-4631-9201-e584c2ec0af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:52.888232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8331e3-b86c-473b-8e47-89acfe583edc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:52.888511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8331e3-b86c-473b-8e47-89acfe583edc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:52.888790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8331e3-b86c-473b-8e47-89acfe583edc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:52.890328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 33/63] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:52.895585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb593c-7be2-4e72-9090-00b32becaede None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:52.896146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb593c-7be2-4e72-9090-00b32becaede None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:52.896608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb593c-7be2-4e72-9090-00b32becaede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:52.902509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-79a9c27e-59ee-4631-9201-e584c2ec0af6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:52.903837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-79a9c27e-59ee-4631-9201-e584c2ec0af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:52.927638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-72fb593c-7be2-4e72-9090-00b32becaede None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:52.930619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-72fb593c-7be2-4e72-9090-00b32becaede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:53.023387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 34/64] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:53.024297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 31/65] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:53.025172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841f31-6c39-42b7-a71f-6d388189dc02 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.025464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841f31-6c39-42b7-a71f-6d388189dc02 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.025830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d841f31-6c39-42b7-a71f-6d388189dc02 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.027242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 35/66] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:53.032640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5a5a-53ab-42bd-a58a-6f1a9dd352cc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.032930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5a5a-53ab-42bd-a58a-6f1a9dd352cc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.033209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5a5a-53ab-42bd-a58a-6f1a9dd352cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.052694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-65ab5a5a-53ab-42bd-a58a-6f1a9dd352cc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:53.053931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-65ab5a5a-53ab-42bd-a58a-6f1a9dd352cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:53.066009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:53.132480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 32/67] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:53.279406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefec45-65fb-4a7c-a7a0-d356ed9b4ca6 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.280082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefec45-65fb-4a7c-a7a0-d356ed9b4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.280557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefec45-65fb-4a7c-a7a0-d356ed9b4ca6 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.282650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 36/68] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:53.287800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c29ac-25e3-4742-a792-e57a04334566 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.288298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c29ac-25e3-4742-a792-e57a04334566 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.288762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c29ac-25e3-4742-a792-e57a04334566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.311717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-929c29ac-25e3-4742-a792-e57a04334566 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:53.313191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-929c29ac-25e3-4742-a792-e57a04334566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:53.351284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefec45-65fb-4a7c-a7a0-d356ed9b4ca6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:53.383692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 33/69] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:53.400174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:53.455761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c29ac-25e3-4742-a792-e57a04334566 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:53.505278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefec45-65fb-4a7c-a7a0-d356ed9b4ca6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:53.540728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:53.541743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.542213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.542670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.557082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:53.562161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:53.563034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:02:53.563835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:02:53.564396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:53.566361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 37/70] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:53.571917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:53.589976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c29ac-25e3-4742-a792-e57a04334566 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:53.633208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:53.634257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.634716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.635149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.648788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:53.656197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:53.657631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:02:53.658401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:02:53.659199 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 34/71] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:02:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:02:53.659981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:53.675832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:53.695095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17594-6412-4bf2-af02-ae7026450f28 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:53.729344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e3f90-55a2-412a-87f2-b184277216b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:53.729985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3f90-55a2-412a-87f2-b184277216b0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.730258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3f90-55a2-412a-87f2-b184277216b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.730535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3f90-55a2-412a-87f2-b184277216b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.740297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e3f90-55a2-412a-87f2-b184277216b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-db2e3f90-55a2-412a-87f2-b184277216b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:53.745031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:53.745912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:02:53.746678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 38/72] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:53.747700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8944-20ee-464d-8185-5e175b542faa None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.747917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8944-20ee-464d-8185-5e175b542faa None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.748184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8944-20ee-464d-8185-5e175b542faa None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.750573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 39/73] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:53.754703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8944-20ee-464d-8185-5e175b542faa None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:53.768877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478929e-ac3b-4ef7-9c52-fa78b05d3cb0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:53.801851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:53.802457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.802736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.803010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.803674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:53.803978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:53.805370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:53.807502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:53.814651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 35/74] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:02:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:53.815458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:53.859201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8944-20ee-464d-8185-5e175b542faa None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:53.893533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:53.894091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.894343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.894614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.895275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:53.895588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:53.896965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:53.904909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 40/75] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:02:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:53.905633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:53.910187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:53.912549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08926bbd-b4d5-45bb-88b0-6bdc96898667 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:53.946353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a579e1-eaa0-4287-b502-69e27f0d9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:53.946972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a579e1-eaa0-4287-b502-69e27f0d9819 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.947255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a579e1-eaa0-4287-b502-69e27f0d9819 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.947529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a579e1-eaa0-4287-b502-69e27f0d9819 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.958063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a579e1-eaa0-4287-b502-69e27f0d9819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f8a579e1-eaa0-4287-b502-69e27f0d9819 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:53.963201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:53.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:02:53.964829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 36/76] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:53.967023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689a26-f039-4809-a466-446d0f72636d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:53.967304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689a26-f039-4809-a466-446d0f72636d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:53.967582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689a26-f039-4809-a466-446d0f72636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:53.984804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-32689a26-f039-4809-a466-446d0f72636d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:53.986046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-32689a26-f039-4809-a466-446d0f72636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:54.005256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3505-77e8-445e-8f25-4963c8d3cc68 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.037980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.038938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.039647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.039823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.040091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.040744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:54.041048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.042434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.050676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 41/77] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:54.051612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.052421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 37/78] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:54.053536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32689a26-f039-4809-a466-446d0f72636d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.123245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.165331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1c47c-ba0e-4e4d-be1d-849290dd8131 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.181017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32689a26-f039-4809-a466-446d0f72636d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.211753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.212882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.213163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.213667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.226518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.227435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.227877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.228217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.230051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.231504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.233170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 42/79] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:54.238293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.246215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.247689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.249680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 38/80] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:54.250999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.302941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.341027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f6894-18a0-4234-a3d6-467b28e09068 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.356905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e0c2-1053-4529-8ea8-775ebe0dd1e6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.370106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.386870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.387688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.388234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.388647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.389819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:54.390564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.392773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.402691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 43/81] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:54.402974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.403817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.403971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.404445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.404917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] PATH_INFO: `/v3/users/6cce99ec4d5640fbb0998973ffaa1781` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.409131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] RBAC: Authorizing `identity:get_user(user_id=6cce99ec4d5640fbb0998973ffaa1781)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.410659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.416805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 39/82] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/users/6cce99ec4d5640fbb0998973ffaa1781 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:54.416805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.514692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3319c-79a5-4d06-a908-2719d9e864f2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.520804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a401-f55e-4fca-88c9-06c4b4c5c3b6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.529824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.550608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.551214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.551496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.551776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.556368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.556969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.557244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.557525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.615845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.626441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.627943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.629914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.631385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.725102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 40/83] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:54.725893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.726968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 44/84] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:54.727795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.746070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.810495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.825653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc6219-e61a-4084-a554-d5bad8a7e018 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.833038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678b969-7c03-411f-9d9d-62aa646b66ab None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.862683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.863119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.863400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.863666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.864807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.866289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.867882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 45/85] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:54.868758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.869912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:54.870577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:54.870859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:54.871130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:54.872427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:54.874712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:54.876367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 41/86] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:54.877692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:54.956522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:54.969833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f385ed-e7d7-4516-aa58-03f0d7da5ee4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:54.975852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355074f-0e85-42dd-b71a-ad378411c193 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.003641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.004252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.004530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.004804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.009330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.009980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.010258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.010526 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.011625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.013041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.014701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 42/87] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:55.015441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.028748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:55.072899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.074374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.113484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cbf21-1503-466f-a577-ba38f2356de3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.146891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.147501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.147779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.148051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.149156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.150617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.152240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 43/88] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:55.152991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.173273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:55.173439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 46/89] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:55.174029 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.231744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:55.258605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def17f1-fd13-4431-a56c-f4c2c9383d18 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.275402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65361427-6537-4369-8833-e3331a53b6d2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.292010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.292618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.292892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.293163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.309242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.309879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.310163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.310434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.311082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.312508 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.340563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 47/90] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:02:55 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:55.341387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.373553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.375287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.396012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:55.456393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939efde-b1d6-40e0-ae7c-85cd6d3fcab6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.468499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:55.492494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 44/91] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:02:55.493273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.502596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.502909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.503505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.503505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.504104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] RBAC: Adding query filter params (role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=a68b15b13af94675b3fa8fc734f85006) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:55.504458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.505882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.511648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 48/92] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/role_assignments?user.id=a68b15b13af94675b3fa8fc734f85006&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:55.512902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.633777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44166-df19-42f5-9052-b000e78d7e79 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.657064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:55.664650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da792013-90d3-4f86-a5b5-c13419880372 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.685046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.685784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.688310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.688310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.688310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=a68b15b13af94675b3fa8fc734f85006) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:55.688310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.688908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.698403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 45/93] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/role_assignments?user.id=a68b15b13af94675b3fa8fc734f85006&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:55.699241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.718507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.720027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.721017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.721493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.723330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.725827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.727841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 49/94] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:55.735465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.810651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:55.873085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462bb44-4389-470b-91e3-1e8194fcee9b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.912941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72268c6-6669-4a27-9e2b-b6db876c05d1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:55.922127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.923176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.923517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.923789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] PATH_INFO: `/v3/projects/9873ed399d8e46deaeb633c93273696c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.925691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] RBAC: Authorizing `identity:get_project(project_id=9873ed399d8e46deaeb633c93273696c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.927485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.929150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 46/95] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/projects/9873ed399d8e46deaeb633c93273696c => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:55.935420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:55.956129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620a62f-8c9c-4bef-acd8-676bb75dcaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:55.956986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a62f-8c9c-4bef-acd8-676bb75dcaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:55.957430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a62f-8c9c-4bef-acd8-676bb75dcaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:55.957880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a62f-8c9c-4bef-acd8-676bb75dcaf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:55.958753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a62f-8c9c-4bef-acd8-676bb75dcaf5 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=6cce99ec4d5640fbb0998973ffaa1781) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:55.959201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a62f-8c9c-4bef-acd8-676bb75dcaf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:55.962619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a62f-8c9c-4bef-acd8-676bb75dcaf5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:55.972701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 50/96] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/role_assignments?user.id=6cce99ec4d5640fbb0998973ffaa1781&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:55.992692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:56.049235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8dd8a-df69-41c6-80e2-b4ae91f907aa None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:56.085922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96715c-85e6-4204-8a7f-890612f8311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:56.086447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96715c-85e6-4204-8a7f-890612f8311c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:56.086724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96715c-85e6-4204-8a7f-890612f8311c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:56.087291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96715c-85e6-4204-8a7f-890612f8311c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:56.088033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96715c-85e6-4204-8a7f-890612f8311c None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=9873ed399d8e46deaeb633c93273696c, user.id=a68b15b13af94675b3fa8fc734f85006) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:56.088332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96715c-85e6-4204-8a7f-890612f8311c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:56.089862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96715c-85e6-4204-8a7f-890612f8311c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:56.096930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 47/97] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:02:55 2022] GET /identity/v3/role_assignments?user.id=a68b15b13af94675b3fa8fc734f85006&scope.project.id=9873ed399d8e46deaeb633c93273696c&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:58.415802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0b51-99fb-41de-a022-95a766ea23ec None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.416310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0b51-99fb-41de-a022-95a766ea23ec None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.416383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0b51-99fb-41de-a022-95a766ea23ec None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.417860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 51/98] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:58.423486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d2d6-3ab5-47ac-93ea-e9bebe8115ed None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.424289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d2d6-3ab5-47ac-93ea-e9bebe8115ed None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.424757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d2d6-3ab5-47ac-93ea-e9bebe8115ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.446838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a2c64-c37e-4f87-bf80-ed622b2cdccf None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.447167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a2c64-c37e-4f87-bf80-ed622b2cdccf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.447322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-86f6d2d6-3ab5-47ac-93ea-e9bebe8115ed None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:58.447414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a2c64-c37e-4f87-bf80-ed622b2cdccf None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.448497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-86f6d2d6-3ab5-47ac-93ea-e9bebe8115ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:58.448718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 52/99] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:58.453661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887132ff-db9e-4230-addb-29c666006399 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.454088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887132ff-db9e-4230-addb-29c666006399 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.454192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887132ff-db9e-4230-addb-29c666006399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.485243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-887132ff-db9e-4230-addb-29c666006399 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:58.486476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-887132ff-db9e-4230-addb-29c666006399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:58.540214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 48/100] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:58.542225 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264b4cb-5c66-4602-8119-b31726b6d879 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.542508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264b4cb-5c66-4602-8119-b31726b6d879 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.542780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264b4cb-5c66-4602-8119-b31726b6d879 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.544021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 49/101] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:58.560125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7cbf-bc20-461c-a100-12ed6df1a212 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.560402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7cbf-bc20-461c-a100-12ed6df1a212 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.560670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7cbf-bc20-461c-a100-12ed6df1a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.590904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 53/102] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:02:58.605872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ceec7cbf-bc20-461c-a100-12ed6df1a212 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:58.607092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ceec7cbf-bc20-461c-a100-12ed6df1a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:58.669267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:58.670413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156061-eed5-447c-a139-de0486a9f5de None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.670829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156061-eed5-447c-a139-de0486a9f5de None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.671223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156061-eed5-447c-a139-de0486a9f5de None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.678107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 54/103] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:58.684561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3c78f-87f8-432e-9e6b-5dc22d07eca9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.685105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3c78f-87f8-432e-9e6b-5dc22d07eca9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.685607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3c78f-87f8-432e-9e6b-5dc22d07eca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.699635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 50/104] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:58.718479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bbc3c78f-87f8-432e-9e6b-5dc22d07eca9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:58.720398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bbc3c78f-87f8-432e-9e6b-5dc22d07eca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:58.759639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:58.782772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a9728-0d2f-4947-b669-8e00ffe84ed6 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.783376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a9728-0d2f-4947-b669-8e00ffe84ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.783875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a9728-0d2f-4947-b669-8e00ffe84ed6 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.785416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 51/105] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:02:58.798641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc557-96e1-44d1-89d5-71851e458830 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:58.799169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc557-96e1-44d1-89d5-71851e458830 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:58.799639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc557-96e1-44d1-89d5-71851e458830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:58.827044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-db1cc557-96e1-44d1-89d5-71851e458830 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:58.828577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-db1cc557-96e1-44d1-89d5-71851e458830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:58.832379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 55/106] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:58.926233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 52/107] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 04:02:58.955392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3c78f-87f8-432e-9e6b-5dc22d07eca9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.052949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cc557-96e1-44d1-89d5-71851e458830 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.101925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3c78f-87f8-432e-9e6b-5dc22d07eca9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.157229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.158121 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.158541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.158983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.160233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:59.161838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:59.163594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 56/108] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:02:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:59.164480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.206836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:59.208548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cc557-96e1-44d1-89d5-71851e458830 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.211956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:59.250073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2de4f-749f-44be-b19f-ff5bd552a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.251441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2de4f-749f-44be-b19f-ff5bd552a294 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.251771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2de4f-749f-44be-b19f-ff5bd552a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.252140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2de4f-749f-44be-b19f-ff5bd552a294 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.263320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2de4f-749f-44be-b19f-ff5bd552a294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-6cd2de4f-749f-44be-b19f-ff5bd552a294 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:59.269860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:59.270942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:02:59.271892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 53/109] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:59.272684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2f16-5cdb-4232-aa5e-c80f9831009b None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.272684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2f16-5cdb-4232-aa5e-c80f9831009b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.272684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2f16-5cdb-4232-aa5e-c80f9831009b None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.274023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 54/110] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:02:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:59.274627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf2f16-5cdb-4232-aa5e-c80f9831009b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.302225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9d7c0-3766-419f-b75c-fec3fc9a6688 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.335430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.336064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.336367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.336642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.347135 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:59.351868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:59.352688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 57/111] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:59.358316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.381723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf2f16-5cdb-4232-aa5e-c80f9831009b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.413984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.414582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.414860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.415131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.415768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:59.417202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:59.445072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 55/112] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:02:59 2022] POST /identity/v3/projects => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:59.446001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.465382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:59.466368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:59.475984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf2d6-ce29-4e55-ae4c-536295400894 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.514278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b931b-0054-45f0-ba3b-3f7ce0ac3eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.514919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b931b-0054-45f0-ba3b-3f7ce0ac3eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.515199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b931b-0054-45f0-ba3b-3f7ce0ac3eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.515472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b931b-0054-45f0-ba3b-3f7ce0ac3eb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.526989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b931b-0054-45f0-ba3b-3f7ce0ac3eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-082b931b-0054-45f0-ba3b-3f7ce0ac3eb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:59.532474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:59.533397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:02:59.534512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 58/113] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:59.535424 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfe876-f938-440f-a151-0f7f13fa8ed7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.535582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfe876-f938-440f-a151-0f7f13fa8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.535831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfe876-f938-440f-a151-0f7f13fa8ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.556473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9acfe876-f938-440f-a151-0f7f13fa8ed7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:59.557773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9acfe876-f938-440f-a151-0f7f13fa8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:59.568451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b87bb-1d16-4f6d-ac9f-d86aae90b295 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.625107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.626156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.626156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.626335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.626988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:59.627291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:59.628700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:59.639710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 56/114] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:59.640523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.653554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 59/115] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:02:59.653554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfe876-f938-440f-a151-0f7f13fa8ed7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.751457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:59.755015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:59.772975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfe876-f938-440f-a151-0f7f13fa8ed7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.782551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51ae8b-fd5d-4ee3-a344-c779412c34fb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.818226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.819450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.819927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.820410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.821322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:59.821551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:59.821999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:59.822374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:59.822744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:59.823109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:59.824165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:59.834950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:02:59.835638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 60/116] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:59.836759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:02:59.846440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:59.847499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:02:59.848555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:02:59.850117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 57/117] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:59.850831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:59.966935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824a016-bda4-4749-959b-f9f3262b18eb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:59.970395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d95a-ffe3-4c7f-bfc3-ce6b5861c7a3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.003243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.003794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.004073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.004345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.004791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.005478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.005598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.005781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.006054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.006714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:00.006997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.007088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.008359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.008590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 58/118] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.013458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.020806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.022081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 61/119] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.027347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.039548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.124254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df535-a5f1-4aaf-91e7-31a2f33ec1e5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.135958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c9b54-ceef-42e6-9cc4-21f049de9c73 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.162298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.162850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.163133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.163406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] PATH_INFO: `/v3/users/cb2b9d36998e40f0a3cf8c6b1dacb946` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.174049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.174660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.174943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.175227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.175888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:00.176316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.177688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2b9d36998e40f0a3cf8c6b1dacb946)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.177793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.179117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.180730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 59/120] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/users/cb2b9d36998e40f0a3cf8c6b1dacb946 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.186195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 62/121] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.186342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.186892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.257214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.271065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.300644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ba487-5888-4ef0-b925-ca4d879cc0e5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.306276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b588f8c-baf6-4d96-97be-7b587f057600 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.336358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.336986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.337538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.337874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.340696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.341330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.341642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.341922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.343055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.345253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.347124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 63/122] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.348716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:00.352264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:00.353531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:00.354364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 60/123] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:00.355791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.459796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bce0f-77ca-4670-88ba-235a39a05e13 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.463960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100aec5-1f36-46fa-9e3b-816af4f6c2dc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.490807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.500334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.501056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.501399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.501781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.502819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.502974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.503470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.503753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.504026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.504705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.506361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 64/124] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.511100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.520072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.599674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.601358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.626489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd2bc9-e357-4a9d-8856-f9c8a9ca136e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.666077 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.666710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.666991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.667271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] PATH_INFO: `/v3/users/6cce99ec4d5640fbb0998973ffaa1781` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.668394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] RBAC: Authorizing `identity:get_user(user_id=6cce99ec4d5640fbb0998973ffaa1781)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.669877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.671637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 65/125] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/users/6cce99ec4d5640fbb0998973ffaa1781 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.672201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.707415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 61/126] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:00.708258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.732559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.752186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:00.782703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00bf9-de6b-4406-8ab8-ad38c3f5c52f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.815755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351611b9-12f1-4198-9b9c-394775ccfd6f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:00.818746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.819064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.819338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.819607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/a68b15b13af94675b3fa8fc734f85006/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.821797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a, user_id=a68b15b13af94675b3fa8fc734f85006, role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.823249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.838780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 66/127] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:00 2022] PUT /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/a68b15b13af94675b3fa8fc734f85006/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:00.845812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.865382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2792d5-055b-4078-a352-946137338661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:00.866034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2792d5-055b-4078-a352-946137338661 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:00.866313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2792d5-055b-4078-a352-946137338661 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:00.866759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2792d5-055b-4078-a352-946137338661 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:00.867440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2792d5-055b-4078-a352-946137338661 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:00.868104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2792d5-055b-4078-a352-946137338661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:00.869547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2792d5-055b-4078-a352-946137338661 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:00.881731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 62/128] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:00.883163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2792d5-055b-4078-a352-946137338661 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:00.974980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2462-1e10-48d7-a484-fd563d4c8ab7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.002771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:01.022107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2792d5-055b-4078-a352-946137338661 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.023055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.023695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.023971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.024239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.025980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.027748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.029578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 67/129] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:01.034415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:01.034983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:01.071357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.072000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.072282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.072556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.073795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.075256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.076911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 63/130] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:00 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:01.081766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:01.149064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c402-5dfe-4a5a-bac8-01963808a3ca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.185018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.185880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.186065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345be09-0c9b-4432-9b63-99b3d81bc6d0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.186343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.186714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.188009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.193546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.193546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 68/131] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:01 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:01.193546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:01.232227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.232890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.233230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.233535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.235527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.236383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.242696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 64/132] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:01 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:01.242696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:01.267327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:01.276642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:01.310799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d364832-39cc-4d49-9454-42347d22b530 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.346611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.347689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.348185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.348652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/a68b15b13af94675b3fa8fc734f85006/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.350812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a, user_id=a68b15b13af94675b3fa8fc734f85006, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.352465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.354381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4950f-7229-4ff8-9827-2eb355082c80 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.369362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 69/133] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:01 2022] PUT /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/a68b15b13af94675b3fa8fc734f85006/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:01.370807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:01.393965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.394875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.395053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.395284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/6cce99ec4d5640fbb0998973ffaa1781/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.397277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a, user_id=6cce99ec4d5640fbb0998973ffaa1781, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.399092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.414346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 65/134] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:01 2022] PUT /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/6cce99ec4d5640fbb0998973ffaa1781/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:01.415303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:01.514032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:01.537008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14a67-33d4-4c29-a185-6bc2ce4a0b9b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.541715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6dced-d874-4c41-ad52-cd7eee801a98 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.602493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aff80-2e7e-43ea-bdc4-8964c06161ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.603238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aff80-2e7e-43ea-bdc4-8964c06161ca None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.603685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aff80-2e7e-43ea-bdc4-8964c06161ca None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.603867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aff80-2e7e-43ea-bdc4-8964c06161ca None admin] PATH_INFO: `/v3/projects/9873ed399d8e46deaeb633c93273696c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.605209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aff80-2e7e-43ea-bdc4-8964c06161ca None admin] RBAC: Authorizing `identity:get_project(project_id=9873ed399d8e46deaeb633c93273696c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.606839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aff80-2e7e-43ea-bdc4-8964c06161ca None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.609297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 66/135] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:01 2022] GET /identity/v3/projects/9873ed399d8e46deaeb633c93273696c => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:01.611421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:01.611532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2553aa-f77f-4cc8-ba1f-ed71f22eacb5 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.611532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2553aa-f77f-4cc8-ba1f-ed71f22eacb5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.611532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2553aa-f77f-4cc8-ba1f-ed71f22eacb5 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.613000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 67/136] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:01.618812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2553aa-f77f-4cc8-ba1f-ed71f22eacb5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:01.622246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab889d59-ea24-4535-94aa-2fc9b7046ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.623297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889d59-ea24-4535-94aa-2fc9b7046ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.623755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889d59-ea24-4535-94aa-2fc9b7046ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.624211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889d59-ea24-4535-94aa-2fc9b7046ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.625002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab889d59-ea24-4535-94aa-2fc9b7046ee8 None admin] RBAC: Adding query filter params (role.id=a99b0b2224eb415c968f6b7cb9de902a, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=cb2b9d36998e40f0a3cf8c6b1dacb946) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:01.625356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab889d59-ea24-4535-94aa-2fc9b7046ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.627083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab889d59-ea24-4535-94aa-2fc9b7046ee8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.633348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 70/137] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:01 2022] GET /identity/v3/role_assignments?user.id=cb2b9d36998e40f0a3cf8c6b1dacb946&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=a99b0b2224eb415c968f6b7cb9de902a => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:01.634640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866aab-f1ae-458c-b60e-8cdce83334f8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.634989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866aab-f1ae-458c-b60e-8cdce83334f8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.635268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81866aab-f1ae-458c-b60e-8cdce83334f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.654348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-81866aab-f1ae-458c-b60e-8cdce83334f8 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:01.657356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-81866aab-f1ae-458c-b60e-8cdce83334f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:01.768139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2553aa-f77f-4cc8-ba1f-ed71f22eacb5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:01.804107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 71/138] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:01.810912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:01.811627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:01.811956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:01.812233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] PATH_INFO: `/v3/projects/9873ed399d8e46deaeb633c93273696c/users/a68b15b13af94675b3fa8fc734f85006/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:01.814347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] RBAC: Authorizing `identity:create_grant(project_id=9873ed399d8e46deaeb633c93273696c, user_id=a68b15b13af94675b3fa8fc734f85006, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:01.815947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:01.837491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 68/139] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:01 2022] PUT /identity/v3/projects/9873ed399d8e46deaeb633c93273696c/users/a68b15b13af94675b3fa8fc734f85006/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:02.108273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866aab-f1ae-458c-b60e-8cdce83334f8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:02.215415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81866aab-f1ae-458c-b60e-8cdce83334f8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:02.240268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:02.250615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e63669-55f6-4666-98f4-ce8c784bdfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:02.251259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e63669-55f6-4666-98f4-ce8c784bdfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:02.251591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e63669-55f6-4666-98f4-ce8c784bdfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:02.251866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e63669-55f6-4666-98f4-ce8c784bdfe0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:02.252986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e63669-55f6-4666-98f4-ce8c784bdfe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:02.254477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e63669-55f6-4666-98f4-ce8c784bdfe0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:02.260663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 72/140] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:02.261551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:02.275007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:02.368422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06e857-2010-40a8-81fb-a5a401c1bd79 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:02.405531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12a913-3fdf-42d1-86fc-a2ba7ca62319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:02.405531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a913-3fdf-42d1-86fc-a2ba7ca62319 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:02.405531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a913-3fdf-42d1-86fc-a2ba7ca62319 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:02.405531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a913-3fdf-42d1-86fc-a2ba7ca62319 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:02.407806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12a913-3fdf-42d1-86fc-a2ba7ca62319 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:02.409246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12a913-3fdf-42d1-86fc-a2ba7ca62319 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:02.433052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 69/141] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:02 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:03:03.289176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4f21-6c21-48e3-88b8-01542fb90ad7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:03.289699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4f21-6c21-48e3-88b8-01542fb90ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:03.289772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4f21-6c21-48e3-88b8-01542fb90ad7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:03.291290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 73/142] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:03.296949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f02f1-e587-4c8f-aef8-cffe9b340fc3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:03.297950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f02f1-e587-4c8f-aef8-cffe9b340fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:03.298126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f02f1-e587-4c8f-aef8-cffe9b340fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:03.320727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d10f02f1-e587-4c8f-aef8-cffe9b340fc3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:03.321955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d10f02f1-e587-4c8f-aef8-cffe9b340fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:03.394675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:03.405127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 70/143] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:03.922434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97502f-1853-46ce-b0f3-b9b021419afc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:03.923051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97502f-1853-46ce-b0f3-b9b021419afc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:03.923051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97502f-1853-46ce-b0f3-b9b021419afc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:03.924314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 74/144] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:03.930184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6b539-1981-4a68-9fb6-1a259afa74b1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:03.930482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6b539-1981-4a68-9fb6-1a259afa74b1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:03.930741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6b539-1981-4a68-9fb6-1a259afa74b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:03.951667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fdf6b539-1981-4a68-9fb6-1a259afa74b1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:03.952851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fdf6b539-1981-4a68-9fb6-1a259afa74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:03.972140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97502f-1853-46ce-b0f3-b9b021419afc None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:04.038024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 71/145] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:04.133498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97502f-1853-46ce-b0f3-b9b021419afc None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:04.176550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:04.177110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.177426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.177733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.190874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:04.195846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:04.196970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:04.197881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 75/146] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:04.204876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6b539-1981-4a68-9fb6-1a259afa74b1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:04.347243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6b539-1981-4a68-9fb6-1a259afa74b1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:04.375116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:04.384320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:04.384996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.385277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.385569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.386241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:04.386555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:04.387986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:04.403289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 72/147] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:04.410590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:04.500193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:04.551729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d98f0e-d05d-4fb8-8105-dc617079ba32 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:04.585186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:04.597467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:04.598141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.598475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.598754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.602203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:04.603681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:04.605551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 76/148] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:04 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:04.611596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:04.736305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8477699-55ef-4dc3-bfd6-7355221de54b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:04.803002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ce03-4643-4138-8c75-927c2e0fce2a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:04.821422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d963d13-cb07-445c-9bba-23e9efe15a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:04.822083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963d13-cb07-445c-9bba-23e9efe15a1c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.822363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963d13-cb07-445c-9bba-23e9efe15a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.822634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963d13-cb07-445c-9bba-23e9efe15a1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.825428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:04.842813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807a8e7-d762-4783-9355-b3bd4ab2717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:04.844015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807a8e7-d762-4783-9355-b3bd4ab2717a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.844952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807a8e7-d762-4783-9355-b3bd4ab2717a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.845528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807a8e7-d762-4783-9355-b3bd4ab2717a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.861534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d963d13-cb07-445c-9bba-23e9efe15a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9d963d13-cb07-445c-9bba-23e9efe15a1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:04.864209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:04.865061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:04.865874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 73/149] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:04.866855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf684dd-06b3-479a-85fb-93d0e9f09f8d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.868852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf684dd-06b3-479a-85fb-93d0e9f09f8d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.868852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf684dd-06b3-479a-85fb-93d0e9f09f8d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.868852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 74/150] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:04.877804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f7770-1e30-4382-8f85-cc4795fe2921 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.878107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f7770-1e30-4382-8f85-cc4795fe2921 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.878381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f7770-1e30-4382-8f85-cc4795fe2921 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.879855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 75/151] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:04.880792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873545fe-c5d6-455a-94e8-2036c4259891 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:04.881066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873545fe-c5d6-455a-94e8-2036c4259891 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:04.881334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873545fe-c5d6-455a-94e8-2036c4259891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:04.924624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-873545fe-c5d6-455a-94e8-2036c4259891 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:04.927108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-873545fe-c5d6-455a-94e8-2036c4259891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:04.987285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807a8e7-d762-4783-9355-b3bd4ab2717a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:04.993530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807a8e7-d762-4783-9355-b3bd4ab2717a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:05.043938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:05.088275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 76/152] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:05.089461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873545fe-c5d6-455a-94e8-2036c4259891 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:05.161441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 77/153] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:05.161441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f69b-9211-47d9-b22b-cf392609aeaf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.161441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f69b-9211-47d9-b22b-cf392609aeaf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.161441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4f69b-9211-47d9-b22b-cf392609aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.190584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-01f4f69b-9211-47d9-b22b-cf392609aeaf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:05.191793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-01f4f69b-9211-47d9-b22b-cf392609aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:05.213618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:05.268884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873545fe-c5d6-455a-94e8-2036c4259891 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:05.302275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 78/154] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:05.303272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4f69b-9211-47d9-b22b-cf392609aeaf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:05.329604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:05.330614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.331160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.331735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.332654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:05.333165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:05.334972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:05.351099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 77/155] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:05.356562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:05.423151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:05.440643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4f69b-9211-47d9-b22b-cf392609aeaf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:05.486217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:05.486866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.487144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.487411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.488594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:05.490074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:05.492071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 79/156] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:05 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:05.502264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:05.513416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51252-351d-4fa7-9970-ec8e8ae990c1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:05.528504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:05.554156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:05.555408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.556391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.556923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] PATH_INFO: `/v3/users/cb2b9d36998e40f0a3cf8c6b1dacb946` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.558416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] RBAC: Authorizing `identity:get_user(user_id=cb2b9d36998e40f0a3cf8c6b1dacb946)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:05.560066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:05.561961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 78/157] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:05 2022] GET /identity/v3/users/cb2b9d36998e40f0a3cf8c6b1dacb946 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:05.571426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:05.709984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb557ff-4d7c-4f39-a846-ca2c182c8279 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:05.757362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91ac9-ecd1-4da7-b3e9-abd6377d5e6f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:05.780402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063a0b-b92a-4ada-8b65-adee8bafdbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:05.781010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063a0b-b92a-4ada-8b65-adee8bafdbbc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.781279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063a0b-b92a-4ada-8b65-adee8bafdbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.789572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063a0b-b92a-4ada-8b65-adee8bafdbbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.790357 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063a0b-b92a-4ada-8b65-adee8bafdbbc None admin] RBAC: Adding query filter params (role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=a68b15b13af94675b3fa8fc734f85006) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:05.790687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063a0b-b92a-4ada-8b65-adee8bafdbbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:05.792090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063a0b-b92a-4ada-8b65-adee8bafdbbc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:05.794453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:05.808723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 80/158] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:05 2022] GET /identity/v3/role_assignments?user.id=a68b15b13af94675b3fa8fc734f85006&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:05.810005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036c92f-5a46-473f-b204-d00ec4df0ae8 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.810275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036c92f-5a46-473f-b204-d00ec4df0ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.810542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036c92f-5a46-473f-b204-d00ec4df0ae8 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.817810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 81/159] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:05.818751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036c92f-5a46-473f-b204-d00ec4df0ae8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:05.841683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c240-4037-44b4-b1bf-b9342a920e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:05.842330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c240-4037-44b4-b1bf-b9342a920e0f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.842604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c240-4037-44b4-b1bf-b9342a920e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.842874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c240-4037-44b4-b1bf-b9342a920e0f None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.844194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c240-4037-44b4-b1bf-b9342a920e0f None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:05.846239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c240-4037-44b4-b1bf-b9342a920e0f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:05.848367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 79/160] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:05 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:05.849603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a72d9-0d20-4094-962e-95dbb0a2e916 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:05.849882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a72d9-0d20-4094-962e-95dbb0a2e916 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:05.850149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a72d9-0d20-4094-962e-95dbb0a2e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:05.874338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bb6a72d9-0d20-4094-962e-95dbb0a2e916 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:05.875705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bb6a72d9-0d20-4094-962e-95dbb0a2e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:05.949228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 80/161] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:05.955044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a72d9-0d20-4094-962e-95dbb0a2e916 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.049845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:06.091145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036c92f-5a46-473f-b204-d00ec4df0ae8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.098661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a72d9-0d20-4094-962e-95dbb0a2e916 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.106773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:06.139661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.140308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.140580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.140852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.152426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:06.157936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:06.158831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:06.159666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 81/162] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:06.160402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.186765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.187468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.187680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.187990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.222150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:06.227071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:06.227983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:06.228758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 82/163] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:06.229439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.265626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274140aa-e897-46a0-b6d9-3bb56e2d52bd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.318989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.319574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.319847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.320113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/cb2b9d36998e40f0a3cf8c6b1dacb946/roles/a99b0b2224eb415c968f6b7cb9de902a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.326535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a, user_id=cb2b9d36998e40f0a3cf8c6b1dacb946, role_id=a99b0b2224eb415c968f6b7cb9de902a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:06.327998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:06.366282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 82/164] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:06 2022] PUT /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/users/cb2b9d36998e40f0a3cf8c6b1dacb946/roles/a99b0b2224eb415c968f6b7cb9de902a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:06.367898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.402880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021ad4-faf0-4ccb-8655-00c1355d1326 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.433896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:06.461586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.461586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.461586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.461586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.462833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:06.462833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:06.462833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:06.470336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 83/165] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:06.478567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.488845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:06.577495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bf7c5-d52f-4cae-a114-f8421a59b91e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.645580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a32e9-d3fa-4268-a055-4edc405639bc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.659346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.660361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.660875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.661404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.662294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:06.662806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:06.664380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:06.678272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 83/166] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:06.679470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.694539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.695116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.695392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.695662 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] PATH_INFO: `/v3/users/6cce99ec4d5640fbb0998973ffaa1781` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.700286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] RBAC: Authorizing `identity:get_user(user_id=6cce99ec4d5640fbb0998973ffaa1781)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:06.701830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:06.703576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 84/167] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:06 2022] GET /identity/v3/users/6cce99ec4d5640fbb0998973ffaa1781 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:06.704185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.792295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564128d-31ba-4378-9538-7ef3266b8503 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.813930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:06.828778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.829626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.830005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.830391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.842253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:06.854777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:06.855880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:06.856671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 84/168] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:06.857450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:06.865847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:06.896488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238e17-3a02-43ef-87b4-c41056fdb78e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:06.932376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31255ac-2692-43b6-b153-64a20782af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:06.933079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31255ac-2692-43b6-b153-64a20782af79 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.933319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31255ac-2692-43b6-b153-64a20782af79 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.935527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31255ac-2692-43b6-b153-64a20782af79 None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.936726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31255ac-2692-43b6-b153-64a20782af79 None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:06.938240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31255ac-2692-43b6-b153-64a20782af79 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:06.940131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 85/169] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:06 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:06.941271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c4d4-8430-4327-a43a-baa46e301ff2 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:06.945637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c4d4-8430-4327-a43a-baa46e301ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:06.945984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c4d4-8430-4327-a43a-baa46e301ff2 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:06.947545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 86/170] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:06.948096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c4d4-8430-4327-a43a-baa46e301ff2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:07.063027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c4d4-8430-4327-a43a-baa46e301ff2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:07.066303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f57fe-dbfa-433e-a31b-0c7c64970b18 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:07.098108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:07.098722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.098997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.099269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.100028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:07.100330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:07.101724 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:07.111394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 87/171] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:07.112046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:07.115650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:07.137440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30156ce9-7676-4abb-a117-4bdf56264d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:07.138169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30156ce9-7676-4abb-a117-4bdf56264d1d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.138456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30156ce9-7676-4abb-a117-4bdf56264d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.138732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30156ce9-7676-4abb-a117-4bdf56264d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.187104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:07.217391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9d02-982e-4cf9-85dd-8ddd4e3b3d8a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:07.259452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:07.260437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.261079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.262592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.291250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30156ce9-7676-4abb-a117-4bdf56264d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:07.293125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30156ce9-7676-4abb-a117-4bdf56264d1d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:07.370902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:07.372808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:07.377552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:07.440569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 85/172] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:07.440569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a884-4485-4b4a-8e29-878702ce96f6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.440569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a884-4485-4b4a-8e29-878702ce96f6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.440569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04a884-4485-4b4a-8e29-878702ce96f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.456635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ec04a884-4485-4b4a-8e29-878702ce96f6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:07.457831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ec04a884-4485-4b4a-8e29-878702ce96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:07.485365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 88/173] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:07.490368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:07.510255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:07.538126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 86/174] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:07.539734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60cebd-f145-4044-a5e8-b050b8b389e2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.540015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60cebd-f145-4044-a5e8-b050b8b389e2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.540278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60cebd-f145-4044-a5e8-b050b8b389e2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.541597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 87/175] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:07.542519 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc79b-5117-4009-bea9-6165407dcae0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.542794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc79b-5117-4009-bea9-6165407dcae0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.543061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc79b-5117-4009-bea9-6165407dcae0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.544237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 88/176] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:07.548343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fc79b-5117-4009-bea9-6165407dcae0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:07.603554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b5df-de2a-46e7-86cd-77a8df8b2d35 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:07.613909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:07.649939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:07.650387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.650697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.650974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] PATH_INFO: `/v3/users/a68b15b13af94675b3fa8fc734f85006` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.652774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] RBAC: Authorizing `identity:get_user(user_id=a68b15b13af94675b3fa8fc734f85006)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:07.659150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:07.666639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 89/177] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:07 2022] GET /identity/v3/users/a68b15b13af94675b3fa8fc734f85006 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:07.666639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:07.680096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fc79b-5117-4009-bea9-6165407dcae0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:07.719924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e9fb0-b58c-452d-a860-0ebc22a36b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:07.720943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9fb0-b58c-452d-a860-0ebc22a36b73 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.721475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9fb0-b58c-452d-a860-0ebc22a36b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.722059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e9fb0-b58c-452d-a860-0ebc22a36b73 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.723361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e9fb0-b58c-452d-a860-0ebc22a36b73 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:07.725219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e9fb0-b58c-452d-a860-0ebc22a36b73 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:07.727237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 89/178] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:07 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:07.728644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79bee-9e29-42bd-ae4e-c5488ddbc509 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.729110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79bee-9e29-42bd-ae4e-c5488ddbc509 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.729594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd79bee-9e29-42bd-ae4e-c5488ddbc509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.749224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-edd79bee-9e29-42bd-ae4e-c5488ddbc509 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:07.751361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-edd79bee-9e29-42bd-ae4e-c5488ddbc509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:07.777194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4c782-ee1c-47b7-bd8a-487ab5c389cb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:07.803922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:07.819272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aceadc-f5a5-4ffd-89e3-e1928b00e5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:07.819899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aceadc-f5a5-4ffd-89e3-e1928b00e5dd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.820176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aceadc-f5a5-4ffd-89e3-e1928b00e5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.820443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aceadc-f5a5-4ffd-89e3-e1928b00e5dd None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.821582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aceadc-f5a5-4ffd-89e3-e1928b00e5dd None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:07.823014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aceadc-f5a5-4ffd-89e3-e1928b00e5dd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:07.824672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 90/179] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:07 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:07.825747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d562-5a79-4ea8-b2b5-c09fc2f6069a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.826025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d562-5a79-4ea8-b2b5-c09fc2f6069a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:07.826289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d562-5a79-4ea8-b2b5-c09fc2f6069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:07.838247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 90/180] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:07.838996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd79bee-9e29-42bd-ae4e-c5488ddbc509 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:07.849932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-de02d562-5a79-4ea8-b2b5-c09fc2f6069a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:07.849932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-de02d562-5a79-4ea8-b2b5-c09fc2f6069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:07.877810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:07.922027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 91/181] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:07.923554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02d562-5a79-4ea8-b2b5-c09fc2f6069a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:07.949890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd79bee-9e29-42bd-ae4e-c5488ddbc509 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:07.998354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:07.999188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:07.999618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.000029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.064064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:08.089548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:08.091203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:08.131462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02d562-5a79-4ea8-b2b5-c09fc2f6069a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.181333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.181903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.182182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.182455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.183239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=6cce99ec4d5640fbb0998973ffaa1781) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:08.183548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:08.185536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:08.194582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 92/182] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:07 2022] GET /identity/v3/role_assignments?user.id=6cce99ec4d5640fbb0998973ffaa1781&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:08.195802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.203763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 91/183] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:08.205111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.265782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:08.328217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:08.363666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a971-7a90-448d-80d2-2cc09bfa902d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.384594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0c947-9561-44b8-9e30-09d59cbd5740 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.408831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.409623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.409988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.410348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.411363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=a68b15b13af94675b3fa8fc734f85006) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:08.411747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:08.413244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:08.424679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 92/184] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/role_assignments?user.id=a68b15b13af94675b3fa8fc734f85006&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:08.424679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.446383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.447350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.447781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.448186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.471345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:08.477074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:08.478271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 93/185] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:08.479725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.569977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df7cf-4df3-4d4c-95e6-9b89b1329403 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.602287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:08.615148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b557-beb6-45c4-a0ff-e6efc77f2c6d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.616098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.616769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.617009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.617282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.627655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:08.631065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:08.638169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:08.639929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:08.642143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:08.643972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 93/186] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:08.643972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.681948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.682851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.683125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.683394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] PATH_INFO: `/v3/projects/9873ed399d8e46deaeb633c93273696c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.685332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] RBAC: Authorizing `identity:get_project(project_id=9873ed399d8e46deaeb633c93273696c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:08.686925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:08.688947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 94/187] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/projects/9873ed399d8e46deaeb633c93273696c => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:08.689579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.795989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c068-7066-4a32-83f3-f8ba917b7586 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.831317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabfe07-f3a0-45e7-b458-e72ef0dbedeb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.833419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.834280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.834556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.834827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.835947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:08.837390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:08.839271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 94/188] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:08.840027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.865841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.866440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.866795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.867009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.867779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:08.868081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:08.869607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:08.878568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 95/189] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:08.879448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:08.904796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:08.911841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:08.945473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac5601-a064-4fd9-a024-8690eab3bf6b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.980498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25704d-f80a-43d3-bdea-bfa71b15c8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:08.981099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25704d-f80a-43d3-bdea-bfa71b15c8cf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.981375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25704d-f80a-43d3-bdea-bfa71b15c8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.981675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25704d-f80a-43d3-bdea-bfa71b15c8cf None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.982330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25704d-f80a-43d3-bdea-bfa71b15c8cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:08.982628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25704d-f80a-43d3-bdea-bfa71b15c8cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:08.984041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25704d-f80a-43d3-bdea-bfa71b15c8cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:08.984368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ca96-eb21-4550-891c-1fe9cf538e46 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:08.994807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 95/190] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:08.999715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584df40-8965-438f-bec7-da70f54fac98 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:08.999715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584df40-8965-438f-bec7-da70f54fac98 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:08.999715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584df40-8965-438f-bec7-da70f54fac98 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:08.999715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 96/191] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:08.999715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584df40-8965-438f-bec7-da70f54fac98 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.026698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.027299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.027570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.028024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.028748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=9873ed399d8e46deaeb633c93273696c, user.id=a68b15b13af94675b3fa8fc734f85006) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:09.029058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:09.030531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:09.037306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 96/192] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:08 2022] GET /identity/v3/role_assignments?user.id=a68b15b13af94675b3fa8fc734f85006&scope.project.id=9873ed399d8e46deaeb633c93273696c&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:09.043558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.129205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584df40-8965-438f-bec7-da70f54fac98 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:09.139836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:09.156266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb0be-5fd2-4154-a01e-21568118fa8f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:09.161668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:09.168936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.169315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.169607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.169878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.170540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:09.171980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:09.195600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 97/193] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:08 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:09.196413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.198359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06de3-c3d2-4892-9f1a-d2eb490ae128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.199209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06de3-c3d2-4892-9f1a-d2eb490ae128 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.199653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06de3-c3d2-4892-9f1a-d2eb490ae128 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.199927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06de3-c3d2-4892-9f1a-d2eb490ae128 None admin] PATH_INFO: `/v3/users/68522c17f7e548c88ee1f8e68452c58a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.220621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af06de3-c3d2-4892-9f1a-d2eb490ae128 None admin] RBAC: Authorizing `identity:get_user(user_id=68522c17f7e548c88ee1f8e68452c58a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:09.222626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af06de3-c3d2-4892-9f1a-d2eb490ae128 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:09.224389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 97/194] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/users/68522c17f7e548c88ee1f8e68452c58a => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:09.227122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39bc50-86c6-407a-9afa-c06b9918a877 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.227122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39bc50-86c6-407a-9afa-c06b9918a877 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.227122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39bc50-86c6-407a-9afa-c06b9918a877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.248394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ee39bc50-86c6-407a-9afa-c06b9918a877 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:09.250756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ee39bc50-86c6-407a-9afa-c06b9918a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:09.330984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e16176-cb9c-4551-a211-bb5491621fed None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:09.341536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 98/195] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:09.341536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39bc50-86c6-407a-9afa-c06b9918a877 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.377192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.377873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.378152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.378429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] PATH_INFO: `/v3/users/68522c17f7e548c88ee1f8e68452c58a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.379685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] RBAC: Authorizing `identity:get_user(user_id=68522c17f7e548c88ee1f8e68452c58a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:09.381107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:09.383805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 98/196] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/users/68522c17f7e548c88ee1f8e68452c58a => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:09.400938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.449403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:09.473883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:09.489459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39bc50-86c6-407a-9afa-c06b9918a877 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:09.537083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.537746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.538023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.538288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.542042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bf45a-4e7f-4dcf-8fd6-37fc3274e512 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:09.589060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.589692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.590071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.590320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.634080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:09.636344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:09.687419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:09.689855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:09.730416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:09.748838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:09.768165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 99/197] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:09.769033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.809663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 99/198] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:03:09.810543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.905554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f05b-29dc-4f69-90e1-af6b20f75f09 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:09.922084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f2fe7-1b92-4dcf-8b25-97e7bbcc30a0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:09.953307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.954959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.955242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.955509 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.967086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:09.968018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:09.968517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:09.969068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:09.970513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:09.970632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:09.972303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:09.974531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 100/199] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:09.975527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:09.976394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:09.977585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 100/200] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:09.978682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:09.980957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:10.005435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:10.028674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:10.089326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2949006-6a81-4645-bbd7-ef5218e291b7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:10.120923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50a81f-8363-41c9-9f1e-ca0b41f8588d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:10.127184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:10.128078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:10.128557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:10.129020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:10.130383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:10.132061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:10.134062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 101/201] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:10.136069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:10.161370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:10.162292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:10.162785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:10.163311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:10.164223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=16690e877c4045de897434640f593aad, user.id=68522c17f7e548c88ee1f8e68452c58a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:10.164720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:10.166602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:10.172475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 101/202] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:09 2022] GET /identity/v3/role_assignments?user.id=68522c17f7e548c88ee1f8e68452c58a&scope.project.id=16690e877c4045de897434640f593aad&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:10.173616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:10.291344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:10.309273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64172ae5-8f67-4b2b-96e0-80bccfa542a7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:10.315778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7b35-747c-4710-9f03-9a953cca9dec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:10.318709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:10.356980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:10.357931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:10.358217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:10.358490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:10.359237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] RBAC: Adding query filter params (role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=16690e877c4045de897434640f593aad, user.id=68522c17f7e548c88ee1f8e68452c58a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:10.359581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:10.361104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:10.367879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 102/203] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:10 2022] GET /identity/v3/role_assignments?user.id=68522c17f7e548c88ee1f8e68452c58a&scope.project.id=16690e877c4045de897434640f593aad&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:10.403505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:10.404528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:10.405043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:10.405524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:10.406425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:10.407498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:10.409098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:10.431671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 102/204] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:10.436894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:10.576562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe95ba-1ac3-4af0-a931-511a1095e452 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:10.616547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:10.617191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:10.617471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:10.617776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] PATH_INFO: `/v3/users/cb2b9d36998e40f0a3cf8c6b1dacb946` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:10.618922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2b9d36998e40f0a3cf8c6b1dacb946)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:10.620439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:10.622412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 103/205] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:10 2022] GET /identity/v3/users/cb2b9d36998e40f0a3cf8c6b1dacb946 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:10.630744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:10.758087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413ca2-e78d-4a64-97ee-f37f3015d8e1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:10.804899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:10.805761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:10.806201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:10.806610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:10.837815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:10.904862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:10.906370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:11.038092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 103/206] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:11.044468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:11.113229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:11.203963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfaada-f841-4e3a-968d-16b24bee12a0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:11.248935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4360e-9aed-423c-abcc-0cf3adc79530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:11.249596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4360e-9aed-423c-abcc-0cf3adc79530 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:11.249878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4360e-9aed-423c-abcc-0cf3adc79530 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:11.250151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4360e-9aed-423c-abcc-0cf3adc79530 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:11.254194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4360e-9aed-423c-abcc-0cf3adc79530 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:11.255643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4360e-9aed-423c-abcc-0cf3adc79530 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:11.257298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 104/207] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:11 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:11.263217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:11.334526 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:11.387240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66822a7-99a8-4b48-ae6b-2cfa64717919 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:11.426296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d2d98-7f59-4f9d-a051-3aa21f357fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:11.426899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2d98-7f59-4f9d-a051-3aa21f357fcb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:11.427177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2d98-7f59-4f9d-a051-3aa21f357fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:11.427446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d2d98-7f59-4f9d-a051-3aa21f357fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:11.428170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d2d98-7f59-4f9d-a051-3aa21f357fcb None admin] RBAC: Adding query filter params (role.id=a99b0b2224eb415c968f6b7cb9de902a, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a, user.id=cb2b9d36998e40f0a3cf8c6b1dacb946) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:11.428484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d2d98-7f59-4f9d-a051-3aa21f357fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:11.429942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d2d98-7f59-4f9d-a051-3aa21f357fcb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:11.436019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 104/208] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:11 2022] GET /identity/v3/role_assignments?user.id=cb2b9d36998e40f0a3cf8c6b1dacb946&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=a99b0b2224eb415c968f6b7cb9de902a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:11.661125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec81f6-f066-4bf1-891b-245850efd7f2 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:11.661437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec81f6-f066-4bf1-891b-245850efd7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:11.661700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec81f6-f066-4bf1-891b-245850efd7f2 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:11.663291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 105/209] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:11.668665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94381720-fd5b-4a6b-b913-ebabb581e02a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:11.669099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94381720-fd5b-4a6b-b913-ebabb581e02a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:11.669265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94381720-fd5b-4a6b-b913-ebabb581e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:11.689548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-94381720-fd5b-4a6b-b913-ebabb581e02a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:11.691059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-94381720-fd5b-4a6b-b913-ebabb581e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:11.764471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 105/210] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:11.784895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71178-423e-4a04-b281-3870acc9d4e1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:11.785374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71178-423e-4a04-b281-3870acc9d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:11.785894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71178-423e-4a04-b281-3870acc9d4e1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:11.788282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 106/211] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:11.795534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf9fa-d823-470e-b25d-836fa9752187 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:11.795857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf9fa-d823-470e-b25d-836fa9752187 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:11.796117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf9fa-d823-470e-b25d-836fa9752187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:11.819238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1ddaf9fa-d823-470e-b25d-836fa9752187 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:11.821245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1ddaf9fa-d823-470e-b25d-836fa9752187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:11.876868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:11.903106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 106/212] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:12.091123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71178-423e-4a04-b281-3870acc9d4e1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:12.180703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf9fa-d823-470e-b25d-836fa9752187 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:12.199409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71178-423e-4a04-b281-3870acc9d4e1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:12.201805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:12.243881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:12.244515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.244793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.245063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.258503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:12.264956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:12.265875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:12.267296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 107/213] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:12.274666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:12.293656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf9fa-d823-470e-b25d-836fa9752187 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:12.330206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39280c4-e862-492d-9412-90627a9455da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:12.331204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39280c4-e862-492d-9412-90627a9455da None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.331853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39280c4-e862-492d-9412-90627a9455da None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.332314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39280c4-e862-492d-9412-90627a9455da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.334200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39280c4-e862-492d-9412-90627a9455da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:12.335849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39280c4-e862-492d-9412-90627a9455da None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:12.341606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 107/214] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:12.344118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39280c4-e862-492d-9412-90627a9455da None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:12.399833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:12.416433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca089cd-a115-4285-ae94-1afe253b04e1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:12.463194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:12.463987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.464279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.464553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.465231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:12.465554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:12.466816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39280c4-e862-492d-9412-90627a9455da None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:12.466924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:12.477320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 108/215] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:12.483399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:12.510672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:12.511638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.512091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.512552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.512971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:12.514714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:12.516646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:12.550068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 108/216] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:12 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:03:12.601866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948f475-d5ee-4727-9fdd-656fdc06bb65 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:12.640471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55334ac8-232d-4561-8943-a00dea95ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:12.641159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334ac8-232d-4561-8943-a00dea95ecbd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.641449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334ac8-232d-4561-8943-a00dea95ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.641748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334ac8-232d-4561-8943-a00dea95ecbd None admin] PATH_INFO: `/v3/users/372270c117a7458494b313fb0b96c9ad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.657321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55334ac8-232d-4561-8943-a00dea95ecbd None admin] RBAC: Authorizing `identity:get_user(user_id=372270c117a7458494b313fb0b96c9ad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:12.658861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55334ac8-232d-4561-8943-a00dea95ecbd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:12.660915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 109/217] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:12 2022] GET /identity/v3/users/372270c117a7458494b313fb0b96c9ad => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:12.666925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:12.775058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:12.778787 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d94c-9e13-4166-8a73-67458a6cb138 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:12.798901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d160b-39a6-4670-8ed6-263ffa8b46bf None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.799108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d160b-39a6-4670-8ed6-263ffa8b46bf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.799373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d160b-39a6-4670-8ed6-263ffa8b46bf None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.800954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 110/218] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:12.807204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95223fe-aebd-4de9-ba1b-7de022923353 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.807488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95223fe-aebd-4de9-ba1b-7de022923353 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.807764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95223fe-aebd-4de9-ba1b-7de022923353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.820656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:12.820656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.820656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.820656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.829621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c95223fe-aebd-4de9-ba1b-7de022923353 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:12.831372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c95223fe-aebd-4de9-ba1b-7de022923353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:12.906501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:12.908506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:12.917757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 111/219] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:12.985838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336cf6-acf2-47a8-ba23-4a0a3f4d8df5 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.986142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336cf6-acf2-47a8-ba23-4a0a3f4d8df5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.986708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336cf6-acf2-47a8-ba23-4a0a3f4d8df5 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.988795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 112/220] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:12.994997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52dd6-776d-4d3f-9e42-2503ee825744 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.995284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52dd6-776d-4d3f-9e42-2503ee825744 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.995569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52dd6-776d-4d3f-9e42-2503ee825744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.019852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bea52dd6-776d-4d3f-9e42-2503ee825744 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:13.021648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bea52dd6-776d-4d3f-9e42-2503ee825744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:13.024695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:13.026875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:13.033116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 109/221] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:13.038933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.123669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 113/222] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:13.154270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716c075-f322-4923-be2b-e6abdfd6c178 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:13.194201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:13.194829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.195104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.195374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.197155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:13.198608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:13.200237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 110/223] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:13.206317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea52dd6-776d-4d3f-9e42-2503ee825744 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.259303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.331084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:13.333208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea52dd6-776d-4d3f-9e42-2503ee825744 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:13.368444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe3f4-48db-4935-9ed6-170be552e99d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:13.404651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:13.405287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.405587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.405859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.407671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:13.408291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.408571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.408845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.409607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=16690e877c4045de897434640f593aad, user.id=372270c117a7458494b313fb0b96c9ad) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:13.409927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:13.411378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:13.417362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:13.422715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:13.424715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:13.426654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 111/224] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:13.429214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.429643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 114/225] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/role_assignments?user.id=372270c117a7458494b313fb0b96c9ad&scope.project.id=16690e877c4045de897434640f593aad&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:13.435190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.449891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:13.592763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00995abf-fac4-4488-a3dd-ef53346b4c9a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:13.631107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0aee5-6e19-467d-8c25-ae50319a5977 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:13.636135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:13.652003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:13.652976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.653449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.654052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.672573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:13.681524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:13.682407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:13.683181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:13.686788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 112/226] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:13.693212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.710617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:13.711582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.712050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.712506 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.713664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:13.714159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:13.715719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:13.731382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 115/227] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:13.738966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.836264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b4e35-88da-42c4-8f70-98a865532955 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:13.854755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:13.874407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:13.875390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.876374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.876943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.877944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:13.878438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:13.879993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:13.889955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 113/228] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:13.895794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.928865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e97e0-9788-4e40-8495-7d64f4dcc64f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:13.967300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:13.968254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.968543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.968815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] PATH_INFO: `/v3/users/68522c17f7e548c88ee1f8e68452c58a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.970138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] RBAC: Authorizing `identity:get_user(user_id=68522c17f7e548c88ee1f8e68452c58a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:13.973790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:13.973790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 116/229] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/users/68522c17f7e548c88ee1f8e68452c58a => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:13.981549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:14.035987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:14.095949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fad99-1950-4f74-bb3d-c6991d707cac None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:14.130791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:14.137812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:14.138685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:14.139153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:14.139704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:14.141008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:14.143367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:14.150242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 117/230] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:14.152177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:14.187585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42302d-5da0-451f-a2b3-d20649590ba6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:14.266569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbbac0-7a4a-42d7-b99e-0f6a0f4371cc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:14.289060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:14.289735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:14.290012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:14.290280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] PATH_INFO: `/v3/users/68522c17f7e548c88ee1f8e68452c58a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:14.291865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=68522c17f7e548c88ee1f8e68452c58a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:14.293630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:14.300622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 114/231] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/users/68522c17f7e548c88ee1f8e68452c58a => generated 283 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:14.301721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:14.308037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:14.308937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:14.309402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:14.309906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad/users/68522c17f7e548c88ee1f8e68452c58a/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:14.312302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] RBAC: Authorizing `identity:create_grant(project_id=16690e877c4045de897434640f593aad, user_id=68522c17f7e548c88ee1f8e68452c58a, role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:14.314032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:14.346580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 118/232] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:14 2022] PUT /identity/v3/projects/16690e877c4045de897434640f593aad/users/68522c17f7e548c88ee1f8e68452c58a/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:03:14.429985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c87b7-ef36-4cdc-baf3-a5f1d4156bb0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:14.449617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:14.470281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1085b7-8826-4027-99ce-8d91f4f3ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:14.470927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1085b7-8826-4027-99ce-8d91f4f3ca8d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:14.471203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1085b7-8826-4027-99ce-8d91f4f3ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:14.471534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1085b7-8826-4027-99ce-8d91f4f3ca8d None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:14.472827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1085b7-8826-4027-99ce-8d91f4f3ca8d None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:14.474336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1085b7-8826-4027-99ce-8d91f4f3ca8d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:14.476499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 115/233] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:14 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:14.482011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:14.566347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:14.609725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5da9be-cfd6-4bcd-ba21-83beaa28598d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:14.647416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a28c9d-532b-470b-8614-5a0d59d99303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:14.648079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28c9d-532b-470b-8614-5a0d59d99303 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:14.648351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28c9d-532b-470b-8614-5a0d59d99303 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:14.648620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a28c9d-532b-470b-8614-5a0d59d99303 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad/users/68522c17f7e548c88ee1f8e68452c58a/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:14.650564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a28c9d-532b-470b-8614-5a0d59d99303 None admin] RBAC: Authorizing `identity:create_grant(project_id=16690e877c4045de897434640f593aad, user_id=68522c17f7e548c88ee1f8e68452c58a, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:14.652023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a28c9d-532b-470b-8614-5a0d59d99303 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:14.672640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 119/234] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:14 2022] PUT /identity/v3/projects/16690e877c4045de897434640f593aad/users/68522c17f7e548c88ee1f8e68452c58a/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:15.085946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f9819-7347-4e77-a2d0-05426b8dfcc1 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:15.086952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f9819-7347-4e77-a2d0-05426b8dfcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:15.087431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f9819-7347-4e77-a2d0-05426b8dfcc1 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:15.089273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 116/235] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:15.095112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f37f8-204b-49fd-afa9-cf29a4693f55 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:15.095392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f37f8-204b-49fd-afa9-cf29a4693f55 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:15.095664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f37f8-204b-49fd-afa9-cf29a4693f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:15.118241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5a5f37f8-204b-49fd-afa9-cf29a4693f55 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:15.119463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5a5f37f8-204b-49fd-afa9-cf29a4693f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:15.143123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb2dd-532d-4a1d-a20c-452f1f84eba8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:15.143447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb2dd-532d-4a1d-a20c-452f1f84eba8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:15.143667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb2dd-532d-4a1d-a20c-452f1f84eba8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:15.145012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 117/236] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:15.150081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e005d-fc3d-4269-ab86-11af550393ee None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:15.150359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e005d-fc3d-4269-ab86-11af550393ee None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:15.150633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e005d-fc3d-4269-ab86-11af550393ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:15.171251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ff7e005d-fc3d-4269-ab86-11af550393ee None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:15.173685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ff7e005d-fc3d-4269-ab86-11af550393ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:15.227303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 120/237] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:15.287677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 118/238] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:15.564759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f37f8-204b-49fd-afa9-cf29a4693f55 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:15.628975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:15.685953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e005d-fc3d-4269-ab86-11af550393ee None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:15.693879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f37f8-204b-49fd-afa9-cf29a4693f55 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:15.735578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:15.737572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:15.738044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:15.738510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:15.766035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:15.772027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:15.772945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:15.773786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:15.788033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 121/239] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:15.789245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:15.891232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e005d-fc3d-4269-ab86-11af550393ee None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:15.911634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:15.936648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef5362-3736-4f34-b823-d4792d330855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:15.937946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5362-3736-4f34-b823-d4792d330855 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:15.939329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5362-3736-4f34-b823-d4792d330855 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:15.940088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5362-3736-4f34-b823-d4792d330855 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:15.941566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef5362-3736-4f34-b823-d4792d330855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:15.943417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef5362-3736-4f34-b823-d4792d330855 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:15.946128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 119/240] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:15.948664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd3a3-60b7-4cd5-a3d9-b6d70045182f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:15.949158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd3a3-60b7-4cd5-a3d9-b6d70045182f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:15.949638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dd3a3-60b7-4cd5-a3d9-b6d70045182f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:15.951135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 120/241] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:15.952030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd3a3-60b7-4cd5-a3d9-b6d70045182f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:15.984523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174839d-4f90-4858-abb4-db0975a30e57 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:15.999008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:16.032410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd99b3-e69e-49de-b931-7beb3245f017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:16.033397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd99b3-e69e-49de-b931-7beb3245f017 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.034671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd99b3-e69e-49de-b931-7beb3245f017 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.035109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd99b3-e69e-49de-b931-7beb3245f017 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.035954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd99b3-e69e-49de-b931-7beb3245f017 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:16.036445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd99b3-e69e-49de-b931-7beb3245f017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:16.038043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd99b3-e69e-49de-b931-7beb3245f017 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:16.050593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 122/242] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:16.052561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab5f7-9178-4558-bd7f-b52b4138af50 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.052992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab5f7-9178-4558-bd7f-b52b4138af50 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.053439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ab5f7-9178-4558-bd7f-b52b4138af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.077025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-091ab5f7-9178-4558-bd7f-b52b4138af50 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:16.078466 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-091ab5f7-9178-4558-bd7f-b52b4138af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:16.079772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dd3a3-60b7-4cd5-a3d9-b6d70045182f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:16.131112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:16.132146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.132146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.132626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.133362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:16.134926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:16.168061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 121/243] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:15 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:16.169466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:16.178892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 123/244] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:16.219453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:16.284432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ef73-10be-4d2c-8775-e98a3dba8e7e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:16.320936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:16.321614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.321892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.322160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] PATH_INFO: `/v3/users/caf1f9a3aa8d4985836cf2f831a152fb` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.337586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] RBAC: Authorizing `identity:get_user(user_id=caf1f9a3aa8d4985836cf2f831a152fb)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:16.339365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:16.341282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 122/245] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:16 2022] GET /identity/v3/users/caf1f9a3aa8d4985836cf2f831a152fb => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:16.346962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ab5f7-9178-4558-bd7f-b52b4138af50 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:16.489348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ab5f7-9178-4558-bd7f-b52b4138af50 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:16.490931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:16.529272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:16.529945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.530220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.530551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.614458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:16.617149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:16.617262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:16.740056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:16.744465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9936599-89d6-411a-941d-7908154e85a7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:16.745213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 124/246] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:16.751098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:16.753454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:16.791129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a18865-b024-402f-9b4a-b12b017cf984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:16.791787 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18865-b024-402f-9b4a-b12b017cf984 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.792084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18865-b024-402f-9b4a-b12b017cf984 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.792462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18865-b024-402f-9b4a-b12b017cf984 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.806279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a18865-b024-402f-9b4a-b12b017cf984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a9a18865-b024-402f-9b4a-b12b017cf984 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:16.811641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:16.812528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:16.813368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 123/247] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:16.822637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3aa8-37b1-4a39-8649-cecd191e47dc None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.822971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3aa8-37b1-4a39-8649-cecd191e47dc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.823188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c3aa8-37b1-4a39-8649-cecd191e47dc None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.825396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 124/248] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:16.826492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c3aa8-37b1-4a39-8649-cecd191e47dc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:16.874450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca0bbf-6cdc-4853-b95c-72dcf702d420 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:16.918795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712927f2-0fe5-4081-abb0-081762dc5d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:16.919369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712927f2-0fe5-4081-abb0-081762dc5d2c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.919698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712927f2-0fe5-4081-abb0-081762dc5d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.919972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712927f2-0fe5-4081-abb0-081762dc5d2c None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.921363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712927f2-0fe5-4081-abb0-081762dc5d2c None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:16.924378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712927f2-0fe5-4081-abb0-081762dc5d2c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:16.926747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 125/249] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:16 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:16.931962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0fb11-91dc-4289-947c-c31df8b172cb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.931962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0fb11-91dc-4289-947c-c31df8b172cb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.931962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0fb11-91dc-4289-947c-c31df8b172cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.954693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-53a0fb11-91dc-4289-947c-c31df8b172cb None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:16.956499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-53a0fb11-91dc-4289-947c-c31df8b172cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:16.979031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c3aa8-37b1-4a39-8649-cecd191e47dc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.019006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.019969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.020444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.021001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.022005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:17.022480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:17.024174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:17.034033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 125/250] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:17.036041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:17.045776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 126/251] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:17.048422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e962-0511-4402-bc0c-2e5c47efc38e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.048779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e962-0511-4402-bc0c-2e5c47efc38e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.049120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e962-0511-4402-bc0c-2e5c47efc38e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.051048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 127/252] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:17.051881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e962-0511-4402-bc0c-2e5c47efc38e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:17.055773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.070501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.165982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e962-0511-4402-bc0c-2e5c47efc38e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.185748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca5922-c749-4fed-a3dc-e00822657ad7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.221467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519550e1-1554-410d-8109-83e840f5b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.222123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519550e1-1554-410d-8109-83e840f5b200 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.222396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519550e1-1554-410d-8109-83e840f5b200 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.222663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519550e1-1554-410d-8109-83e840f5b200 None admin] PATH_INFO: `/v3/users/372270c117a7458494b313fb0b96c9ad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.224414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519550e1-1554-410d-8109-83e840f5b200 None admin] RBAC: Authorizing `identity:get_user(user_id=372270c117a7458494b313fb0b96c9ad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:17.225878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519550e1-1554-410d-8109-83e840f5b200 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:17.228831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 128/253] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:17 2022] GET /identity/v3/users/372270c117a7458494b313fb0b96c9ad => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:17.229967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d69a52-0924-4ece-95d4-bf87feb69d5e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.230244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d69a52-0924-4ece-95d4-bf87feb69d5e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.230512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d69a52-0924-4ece-95d4-bf87feb69d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.251953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.254209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.254487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.254755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.257052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] RBAC: Adding query filter params (role.id=a99b0b2224eb415c968f6b7cb9de902a, scope.project.id=16690e877c4045de897434640f593aad, user.id=caf1f9a3aa8d4985836cf2f831a152fb) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:17.257416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:17.259422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:17.268414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d3d69a52-0924-4ece-95d4-bf87feb69d5e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:17.271217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 126/254] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:17 2022] GET /identity/v3/role_assignments?user.id=caf1f9a3aa8d4985836cf2f831a152fb&scope.project.id=16690e877c4045de897434640f593aad&role.id=a99b0b2224eb415c968f6b7cb9de902a => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:17.271951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:17.272463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d3d69a52-0924-4ece-95d4-bf87feb69d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:17.393572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.405186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 129/255] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:17.420837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.444102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857d9f-7531-47a5-b335-742d10e9a83a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.457090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d69a52-0924-4ece-95d4-bf87feb69d5e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:17.518883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.519523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.519835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.520104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.526260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:17.527659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:17.533533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 127/256] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:17 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:17.538551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:17.627463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d69a52-0924-4ece-95d4-bf87feb69d5e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.712051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.718120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.718645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.719137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.736577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:17.742976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:17.743847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:17.744625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:17.746860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 130/257] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:17.754663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:17.764637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443067-b38a-4a9b-9042-0f5287e4fedf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.806137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.806716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.807034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.807302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad/users/372270c117a7458494b313fb0b96c9ad/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.811102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] RBAC: Authorizing `identity:create_grant(project_id=16690e877c4045de897434640f593aad, user_id=372270c117a7458494b313fb0b96c9ad, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:17.812771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:17.860073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 128/258] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:17 2022] PUT /identity/v3/projects/16690e877c4045de897434640f593aad/users/372270c117a7458494b313fb0b96c9ad/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:03:17.860930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:17.861575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.897330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.932767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002658-2284-472a-b110-24c3a64a4eb3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.982185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.983578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.984010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.984457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.986065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:17.986511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:17.988122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:17.999642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 131/259] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:18.009990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:18.094331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04636fa-7612-41e5-b0f4-67b632c9e735 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:18.133013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:18.134003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:18.134280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:18.134552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:18.146775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7c15-6806-4848-a646-2b5f9d8620bc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:18.151485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:18.157779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:18.158963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:18.159946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:18.162309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 129/260] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:18.167439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:18.171533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:18.198292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:18.198925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:18.199475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:18.199744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] PATH_INFO: `/v3/users/68522c17f7e548c88ee1f8e68452c58a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:18.200993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] RBAC: Authorizing `identity:get_user(user_id=68522c17f7e548c88ee1f8e68452c58a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:18.204656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:18.208996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 132/261] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:18 2022] GET /identity/v3/users/68522c17f7e548c88ee1f8e68452c58a => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:18.218652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:18.305014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:18.361713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0b87c-29bd-41ba-956a-fe509713bca3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:18.405549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb6b8-ff19-466a-b422-f45f2e01236e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:18.427163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:18.427765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:18.428040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:18.428310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:18.428973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:18.429273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:18.430669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:18.448922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 130/262] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:18.454361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:18.468281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:18.468978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:18.469318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:18.469822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:18.586842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:18.616883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:18.619062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:18.626756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6e5da-34be-4420-85b3-2822a6cdb0fb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:18.684120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:18.684759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:18.685035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:18.685305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] PATH_INFO: `/v3/users/68522c17f7e548c88ee1f8e68452c58a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:18.686599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] RBAC: Authorizing `identity:get_user(user_id=68522c17f7e548c88ee1f8e68452c58a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:18.688874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:18.690813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 131/263] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:18 2022] GET /identity/v3/users/68522c17f7e548c88ee1f8e68452c58a => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:18.699483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:18.706235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:18.870171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 133/264] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:18.875777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:18.877299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1090026-c0c6-464d-9350-a9bb1b91b57b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:18.967187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:18.967796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:18.968070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:18.968337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.062052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:19.103532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7792-92c5-470c-a829-2c9fedb87403 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:19.105824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:19.107508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:19.109589 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:19.171188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:19.171803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.172088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.172564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.173503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:19.179037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:19.181010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 134/265] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:18 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:19.186467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:19.218974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 132/266] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:19.225924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:19.375514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538acc0a-31c7-4810-97d1-9437beedd5c1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:19.378822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:19.411641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53e67-6343-4ee6-9a5d-39a6471e6390 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:19.419513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa0aa5-2433-43c9-8765-07bca18b1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:19.420442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa0aa5-2433-43c9-8765-07bca18b1c52 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.420953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa0aa5-2433-43c9-8765-07bca18b1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.421474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa0aa5-2433-43c9-8765-07bca18b1c52 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.423403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa0aa5-2433-43c9-8765-07bca18b1c52 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:19.425547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa0aa5-2433-43c9-8765-07bca18b1c52 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:19.427545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 133/267] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:19 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:19.428899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a89b-a481-481f-8543-0e774279c1b5 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.429409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a89b-a481-481f-8543-0e774279c1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.429977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1a89b-a481-481f-8543-0e774279c1b5 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.431394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 134/268] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:19.439303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28796c-0bdf-4f7c-ba03-0cfa5d7bdc3e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.439870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28796c-0bdf-4f7c-ba03-0cfa5d7bdc3e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.440340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28796c-0bdf-4f7c-ba03-0cfa5d7bdc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.466076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:19.466681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.466948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.467210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.467939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] RBAC: Adding query filter params (role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=16690e877c4045de897434640f593aad, user.id=68522c17f7e548c88ee1f8e68452c58a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:19.468238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:19.469717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:19.481455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cd28796c-0bdf-4f7c-ba03-0cfa5d7bdc3e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:19.482693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cd28796c-0bdf-4f7c-ba03-0cfa5d7bdc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:19.484890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 135/269] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:19 2022] GET /identity/v3/role_assignments?user.id=68522c17f7e548c88ee1f8e68452c58a&scope.project.id=16690e877c4045de897434640f593aad&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:19.486459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:19.535052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:19.681358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 135/270] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:19.683823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c4b1-3892-4a3b-aa98-d856a0d1a7de None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:19.734886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6838bb-62ee-4f5d-9fc0-678ea582eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:19.735529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6838bb-62ee-4f5d-9fc0-678ea582eb41 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.735804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6838bb-62ee-4f5d-9fc0-678ea582eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.736074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6838bb-62ee-4f5d-9fc0-678ea582eb41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.736793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6838bb-62ee-4f5d-9fc0-678ea582eb41 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=16690e877c4045de897434640f593aad, user.id=68522c17f7e548c88ee1f8e68452c58a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:19.737098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6838bb-62ee-4f5d-9fc0-678ea582eb41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:19.738548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6838bb-62ee-4f5d-9fc0-678ea582eb41 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:19.748760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 136/271] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:19 2022] GET /identity/v3/role_assignments?user.id=68522c17f7e548c88ee1f8e68452c58a&scope.project.id=16690e877c4045de897434640f593aad&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:19.839119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c629b0-86bc-4e63-9f53-2c6200482941 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.839441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c629b0-86bc-4e63-9f53-2c6200482941 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.839663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c629b0-86bc-4e63-9f53-2c6200482941 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.841452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 136/272] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:19.846671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052f5c-024a-487f-84c0-8c30f03f1769 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.846954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052f5c-024a-487f-84c0-8c30f03f1769 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.847225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79052f5c-024a-487f-84c0-8c30f03f1769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.873947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-79052f5c-024a-487f-84c0-8c30f03f1769 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:19.875156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-79052f5c-024a-487f-84c0-8c30f03f1769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:19.920381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f899ddb-b640-4145-ae92-3e734811784c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.920742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f899ddb-b640-4145-ae92-3e734811784c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.920926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f899ddb-b640-4145-ae92-3e734811784c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.923095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 137/273] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:19.930152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4ae69-7281-4fc8-9476-bd065c9ee1da None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.930437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4ae69-7281-4fc8-9476-bd065c9ee1da None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.930690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4ae69-7281-4fc8-9476-bd065c9ee1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.951883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-08d4ae69-7281-4fc8-9476-bd065c9ee1da None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:19.953448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08d4ae69-7281-4fc8-9476-bd065c9ee1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:19.966880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 137/274] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:20.029685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79052f5c-024a-487f-84c0-8c30f03f1769 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.049645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 138/275] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:20.051563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.151398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79052f5c-024a-487f-84c0-8c30f03f1769 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.194050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.195177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.195596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.196152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.206940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:20.212108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:20.213455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:20.214503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:20.216847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 138/276] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:20.222354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4ae69-7281-4fc8-9476-bd065c9ee1da None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.260331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.304354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.367244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4ae69-7281-4fc8-9476-bd065c9ee1da None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.408846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.409961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.410631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.411008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.411231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.411983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:20.413426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:20.415512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:20.431172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 139/277] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:20.431172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.436313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4460dea-1658-4cbd-9c9c-d1bec43e9c00 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.474497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.475056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.475748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.476021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.477514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:20.479309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:20.481324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 139/278] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:20.482152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.533010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.542442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c998-8207-4c16-b7b8-305c07121fda None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.576067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.576700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.576975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.577245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.587790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:20.592997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:20.594078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:20.595434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 140/279] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:20.596082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.600119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29745acf-0b73-4c32-9295-f02e73cb12d0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.633993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412f60-8762-4a10-8510-d6a37f24f124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.634610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412f60-8762-4a10-8510-d6a37f24f124 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.634883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412f60-8762-4a10-8510-d6a37f24f124 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.635149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412f60-8762-4a10-8510-d6a37f24f124 None admin] PATH_INFO: `/v3/users/234bf4bfa9d643dd82144db74f0139be` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.646431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.648588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412f60-8762-4a10-8510-d6a37f24f124 None admin] RBAC: Authorizing `identity:get_user(user_id=234bf4bfa9d643dd82144db74f0139be)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:20.650067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412f60-8762-4a10-8510-d6a37f24f124 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:20.651868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 140/280] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/users/234bf4bfa9d643dd82144db74f0139be => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:20.658680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479540eb-fecc-4ea5-8424-89b3af0cfa7d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.659146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479540eb-fecc-4ea5-8424-89b3af0cfa7d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.659418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479540eb-fecc-4ea5-8424-89b3af0cfa7d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.660685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 141/281] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:20.661375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479540eb-fecc-4ea5-8424-89b3af0cfa7d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.697155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44858-7002-40de-b126-b3abd8145b41 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.729992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.730672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.731645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.731920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.732556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:20.734022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:20.754820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 141/282] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:20 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:20.755626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.763175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479540eb-fecc-4ea5-8424-89b3af0cfa7d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.769825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.803423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6529d-f4c2-4e26-9aae-d66bd296a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.804053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6529d-f4c2-4e26-9aae-d66bd296a573 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.804335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6529d-f4c2-4e26-9aae-d66bd296a573 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.804602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6529d-f4c2-4e26-9aae-d66bd296a573 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.805272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6529d-f4c2-4e26-9aae-d66bd296a573 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:20.805604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6529d-f4c2-4e26-9aae-d66bd296a573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:20.807032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6529d-f4c2-4e26-9aae-d66bd296a573 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:20.817740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 142/283] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:20.822600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bea14f-53e4-4e0b-a0ce-47e3d1f31e18 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.822600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bea14f-53e4-4e0b-a0ce-47e3d1f31e18 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.822600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bea14f-53e4-4e0b-a0ce-47e3d1f31e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.840534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a4bea14f-53e4-4e0b-a0ce-47e3d1f31e18 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:20.841802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a4bea14f-53e4-4e0b-a0ce-47e3d1f31e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:20.882807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0a1f-e810-4d60-97de-a93ff47c8f60 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.903350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.917087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 143/284] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:20.918505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bea14f-53e4-4e0b-a0ce-47e3d1f31e18 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.927551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.928524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.928799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.929063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.930109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, user.id=234bf4bfa9d643dd82144db74f0139be, scope.system=all) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:20.930411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:20.931829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:20.937069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 142/285] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/role_assignments?user.id=234bf4bfa9d643dd82144db74f0139be&scope.system=all&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:21.045441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bea14f-53e4-4e0b-a0ce-47e3d1f31e18 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:21.090031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:21.090713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:21.090990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:21.091290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] PATH_INFO: `/v3/users/caf1f9a3aa8d4985836cf2f831a152fb` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:21.092429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] RBAC: Authorizing `identity:get_user(user_id=caf1f9a3aa8d4985836cf2f831a152fb)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:21.093889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:21.095597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 144/286] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/users/caf1f9a3aa8d4985836cf2f831a152fb => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:21.101359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:21.193784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:21.198012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:21.254783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26db2d-6b33-44ab-9479-7e6ca011f136 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:21.281709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:21.308556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:21.309118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:21.309394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:21.309695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:21.314390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:21.315836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:21.317763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 143/287] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:21 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:21.324230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:21.366998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf32eed-342d-4166-897d-59629a002a92 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:21.427713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:21.428353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:21.428628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:21.428895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:21.466445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:21.471937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:21.472868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:21.474107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 145/288] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:21.482534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:21.482699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ab786-bef3-4ff6-8dd9-ee0598dbb057 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:21.538426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:21.539623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:21.540101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:21.540585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad/users/caf1f9a3aa8d4985836cf2f831a152fb/roles/a99b0b2224eb415c968f6b7cb9de902a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:21.542740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] RBAC: Authorizing `identity:create_grant(project_id=16690e877c4045de897434640f593aad, user_id=caf1f9a3aa8d4985836cf2f831a152fb, role_id=a99b0b2224eb415c968f6b7cb9de902a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:21.544396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:21.556473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:21.560527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 144/289] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:21 2022] PUT /identity/v3/projects/16690e877c4045de897434640f593aad/users/caf1f9a3aa8d4985836cf2f831a152fb/roles/a99b0b2224eb415c968f6b7cb9de902a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:21.677576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365c9f7-2065-4c31-8ce5-bc0692230cdf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:21.704951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:21.732414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:21.733539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:21.734018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:21.734486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:21.735423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:21.735977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:21.737623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:21.751862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 146/290] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:21.757699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:21.865125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13abea1-cf33-4268-8b90-e75193229041 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:21.900276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:21.901256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:21.901759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:21.902227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] PATH_INFO: `/v3/users/372270c117a7458494b313fb0b96c9ad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:21.903655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] RBAC: Authorizing `identity:get_user(user_id=372270c117a7458494b313fb0b96c9ad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:21.905294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:21.907479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 145/291] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:21 2022] GET /identity/v3/users/372270c117a7458494b313fb0b96c9ad => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:21.913234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:22.026761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b6add-350a-40ed-a650-bd4b6244e066 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:22.062195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:22.063144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:22.064160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:22.064628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:22.118617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:22.140920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:22.143296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:22.249801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 147/292] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:22.258780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:22.341925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:22.390943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923f6ef-e6d2-4ea6-80cd-371f27bc85cb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:22.461681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0ced2-510d-4c8d-9955-95bd6b8f129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:22.462675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0ced2-510d-4c8d-9955-95bd6b8f129e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:22.463426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0ced2-510d-4c8d-9955-95bd6b8f129e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:22.463892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0ced2-510d-4c8d-9955-95bd6b8f129e None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:22.470267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0ced2-510d-4c8d-9955-95bd6b8f129e None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:22.471916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0ced2-510d-4c8d-9955-95bd6b8f129e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:22.473800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 146/293] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:22 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:22.479861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:22.613628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:22.639239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558241-41c4-4276-a223-6d88f224ae65 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:22.690278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d184-fb78-486e-b0af-3ff3fafc5104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:22.690806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d184-fb78-486e-b0af-3ff3fafc5104 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:22.691078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d184-fb78-486e-b0af-3ff3fafc5104 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:22.691342 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d184-fb78-486e-b0af-3ff3fafc5104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:22.692059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d184-fb78-486e-b0af-3ff3fafc5104 None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=16690e877c4045de897434640f593aad, user.id=372270c117a7458494b313fb0b96c9ad) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:22.692359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d184-fb78-486e-b0af-3ff3fafc5104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:22.693951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d184-fb78-486e-b0af-3ff3fafc5104 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:22.700050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 148/294] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:22 2022] GET /identity/v3/role_assignments?user.id=372270c117a7458494b313fb0b96c9ad&scope.project.id=16690e877c4045de897434640f593aad&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:22.975543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398ce9-c2e3-4071-bf55-1ab09fdcd433 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:22.976032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398ce9-c2e3-4071-bf55-1ab09fdcd433 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:22.976032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86398ce9-c2e3-4071-bf55-1ab09fdcd433 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:22.977470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 147/295] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:22.982911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657489-a43b-47a1-8f53-c0fa8b9f4123 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:22.983433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657489-a43b-47a1-8f53-c0fa8b9f4123 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:22.983903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657489-a43b-47a1-8f53-c0fa8b9f4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.005694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0f657489-a43b-47a1-8f53-c0fa8b9f4123 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:23.007243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0f657489-a43b-47a1-8f53-c0fa8b9f4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:23.079463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 149/296] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:23.324383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582ed9-4d7d-4cbd-9252-984f96b75938 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.325022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582ed9-4d7d-4cbd-9252-984f96b75938 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.325494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc582ed9-4d7d-4cbd-9252-984f96b75938 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.327209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 148/297] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:23.333487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae32a-3644-4c10-9e51-7a01de144397 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.334026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae32a-3644-4c10-9e51-7a01de144397 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.334492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae32a-3644-4c10-9e51-7a01de144397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.350637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3da0e-8e05-4987-a22d-27c2e8dbb14d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.351248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3da0e-8e05-4987-a22d-27c2e8dbb14d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.351731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3da0e-8e05-4987-a22d-27c2e8dbb14d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.353261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 149/298] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:23.362224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3d5ae32a-3644-4c10-9e51-7a01de144397 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:23.362788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd93b15-fc87-43ab-96a0-6c127a1b9e4f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.363272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd93b15-fc87-43ab-96a0-6c127a1b9e4f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.363461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3d5ae32a-3644-4c10-9e51-7a01de144397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:23.363909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd93b15-fc87-43ab-96a0-6c127a1b9e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.385207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ffd93b15-fc87-43ab-96a0-6c127a1b9e4f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:23.386436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ffd93b15-fc87-43ab-96a0-6c127a1b9e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:23.435753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 150/299] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:23.436589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae32a-3644-4c10-9e51-7a01de144397 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:23.447715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:23.458486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 150/300] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:23.550545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae32a-3644-4c10-9e51-7a01de144397 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:23.596941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:23.598644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.598644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.598644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.609039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:23.614178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:23.615277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:23.616346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:23.618302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 151/301] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:23.624066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd93b15-fc87-43ab-96a0-6c127a1b9e4f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:23.690851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:23.722493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:23.731421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd93b15-fc87-43ab-96a0-6c127a1b9e4f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:23.776533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:23.777578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.778365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.778857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.779722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:23.780228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:23.782579 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:23.793576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 151/302] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:23.794101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:23.797073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:23.835296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a483a-27f3-4540-9246-293276ac2b88 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:23.873386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:23.873940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.874204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.874473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.875589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:23.877733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:23.879514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 152/303] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:23.880183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:23.921492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0be543-8d12-4535-9b26-cb2286526115 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:23.951076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:23.960592 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:23.961355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.961644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.961910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.973132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:23.978854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:23.980147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 152/304] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:23.981027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:23.992044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258e80-96b6-43f4-a42e-4aa8b84645d9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:24.026765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:24.027382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.027652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.027914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] PATH_INFO: `/v3/users/234bf4bfa9d643dd82144db74f0139be` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.029022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] RBAC: Authorizing `identity:get_user(user_id=234bf4bfa9d643dd82144db74f0139be)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:24.030472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:24.032037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 153/305] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:23 2022] GET /identity/v3/users/234bf4bfa9d643dd82144db74f0139be => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:24.034468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:24.039257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:24.087360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7953-80b5-4ce7-b3d2-3424f550586c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:24.122722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:24.123323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.123702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.123913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] PATH_INFO: `/v3/groups` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.124556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:24.126068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:24.140724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 153/306] 10.222.0.69 () {60 vars in 1134 bytes} [Tue Aug 30 04:03:23 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:24.141541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:24.143382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82240322-7875-4cee-8e15-4c2f2bda9276 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:24.202778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:24.206263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580422-e4fb-494f-8965-0ef7c00ed8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:24.207156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580422-e4fb-494f-8965-0ef7c00ed8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.207431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580422-e4fb-494f-8965-0ef7c00ed8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.207703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580422-e4fb-494f-8965-0ef7c00ed8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.208383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580422-e4fb-494f-8965-0ef7c00ed8d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:24.208679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580422-e4fb-494f-8965-0ef7c00ed8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:24.210958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580422-e4fb-494f-8965-0ef7c00ed8d2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:24.223794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 154/307] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:24.224916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2a26-8776-4664-b7e6-558ef52b2674 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.225197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2a26-8776-4664-b7e6-558ef52b2674 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.225672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2a26-8776-4664-b7e6-558ef52b2674 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.226996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 155/308] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:24.230571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2a26-8776-4664-b7e6-558ef52b2674 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:24.271033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee854877-dcd4-4e23-ae08-7bbf31344209 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:24.302373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:24.311806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869ec08-4c5d-4a5b-839d-83a764379456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:24.312462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869ec08-4c5d-4a5b-839d-83a764379456 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.312739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869ec08-4c5d-4a5b-839d-83a764379456 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.313007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869ec08-4c5d-4a5b-839d-83a764379456 None admin] PATH_INFO: `/v3/system/users/234bf4bfa9d643dd82144db74f0139be/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.314685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869ec08-4c5d-4a5b-839d-83a764379456 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=234bf4bfa9d643dd82144db74f0139be, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:24.316066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869ec08-4c5d-4a5b-839d-83a764379456 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:24.324637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 154/309] 10.222.0.69 () {58 vars in 1334 bytes} [Tue Aug 30 04:03:24 2022] PUT /identity/v3/system/users/234bf4bfa9d643dd82144db74f0139be/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:24.326761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea428-d367-417a-9cef-a4f497d50dd3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.327040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea428-d367-417a-9cef-a4f497d50dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.327419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfea428-d367-417a-9cef-a4f497d50dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.349089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fbfea428-d367-417a-9cef-a4f497d50dd3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:24.350392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fbfea428-d367-417a-9cef-a4f497d50dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:24.362725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2a26-8776-4664-b7e6-558ef52b2674 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:24.405746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:24.406330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.406728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.407002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] PATH_INFO: `/v3/users/2864fe8feb3e425e8fc34646cfc8f6d8` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.428345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=2864fe8feb3e425e8fc34646cfc8f6d8)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:24.430221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:24.433082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 156/310] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:24 2022] GET /identity/v3/users/2864fe8feb3e425e8fc34646cfc8f6d8 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:24.439402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:24.444341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 155/311] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:24.548653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be699f3d-9358-4aa9-b351-0b950e6eb2d6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:24.574213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:24.592907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:24.593824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.594670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.594670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.595836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] RBAC: Adding query filter params (role.id=a99b0b2224eb415c968f6b7cb9de902a, user.id=2864fe8feb3e425e8fc34646cfc8f6d8, scope.system=all) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:24.596138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:24.597580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:24.603340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 157/312] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 30 04:03:24 2022] GET /identity/v3/role_assignments?user.id=2864fe8feb3e425e8fc34646cfc8f6d8&scope.system=all&role.id=a99b0b2224eb415c968f6b7cb9de902a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:24.733501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea428-d367-417a-9cef-a4f497d50dd3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:24.778802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:24.839153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfea428-d367-417a-9cef-a4f497d50dd3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:24.873634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:24.874267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:24.874539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:24.874803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:24.885954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:24.890814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:24.892266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:24.893046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 156/313] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:24.902619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:25.009865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340da4-e111-4779-b882-8377af634cc6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:25.045641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:25.046536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:25.046985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:25.047425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:25.048330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:25.048831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:25.050392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:25.064714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 158/314] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:25.066304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:25.173553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a51c-86aa-4670-a63d-6fbb1a3548c9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:25.175319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:25.209546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:25.210485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:25.210947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:25.211389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] PATH_INFO: `/v3/users/caf1f9a3aa8d4985836cf2f831a152fb` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:25.212697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] RBAC: Authorizing `identity:get_user(user_id=caf1f9a3aa8d4985836cf2f831a152fb)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:25.214574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:25.221162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 157/315] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:25 2022] GET /identity/v3/users/caf1f9a3aa8d4985836cf2f831a152fb => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:25.222794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:25.279497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:25.333121 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43222db0-c9e7-4e33-bfc2-2d37b7a6c81a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:25.367199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:25.367802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:25.368076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:25.368339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:25.436187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:25.437666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:25.498969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:25.540021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 159/316] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:25.545677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:25.650686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3f62-efa9-4aa4-964a-2306e5af96c7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:25.685141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dcbdc-21e6-4836-98ba-081b4375b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:25.686113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dcbdc-21e6-4836-98ba-081b4375b981 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:25.686592 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dcbdc-21e6-4836-98ba-081b4375b981 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:25.687073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dcbdc-21e6-4836-98ba-081b4375b981 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:25.688934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dcbdc-21e6-4836-98ba-081b4375b981 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:25.690685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dcbdc-21e6-4836-98ba-081b4375b981 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:25.697652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 158/317] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:25 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:25.699414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:25.805712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486887-9600-4ead-97f9-39114fc5c867 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:25.840852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c8d5c-7522-4b1d-be1e-4ee074e4e182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:25.841446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c8d5c-7522-4b1d-be1e-4ee074e4e182 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:25.841743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c8d5c-7522-4b1d-be1e-4ee074e4e182 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:25.842006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c8d5c-7522-4b1d-be1e-4ee074e4e182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:25.842722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c8d5c-7522-4b1d-be1e-4ee074e4e182 None admin] RBAC: Adding query filter params (role.id=a99b0b2224eb415c968f6b7cb9de902a, scope.project.id=16690e877c4045de897434640f593aad, user.id=caf1f9a3aa8d4985836cf2f831a152fb) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:25.843015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c8d5c-7522-4b1d-be1e-4ee074e4e182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:25.844428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c8d5c-7522-4b1d-be1e-4ee074e4e182 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:25.850589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 160/318] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:25 2022] GET /identity/v3/role_assignments?user.id=caf1f9a3aa8d4985836cf2f831a152fb&scope.project.id=16690e877c4045de897434640f593aad&role.id=a99b0b2224eb415c968f6b7cb9de902a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:26.145486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87012-79de-46b3-83a8-3876bf5ef001 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.146084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87012-79de-46b3-83a8-3876bf5ef001 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.146084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87012-79de-46b3-83a8-3876bf5ef001 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.147569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 159/319] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:26.152550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6681-0650-44c9-a5f2-15a451089e7d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.152842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6681-0650-44c9-a5f2-15a451089e7d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.153113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d6681-0650-44c9-a5f2-15a451089e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.170953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-510d6681-0650-44c9-a5f2-15a451089e7d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:26.172127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-510d6681-0650-44c9-a5f2-15a451089e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:26.180954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:26.243461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 161/320] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:26.394993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfcf4a-40a6-4157-abab-d3f51cbd4334 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.395348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfcf4a-40a6-4157-abab-d3f51cbd4334 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.395595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfcf4a-40a6-4157-abab-d3f51cbd4334 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.397035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 160/321] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:26.401933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6977c-f79f-4769-afef-360344ba66fc None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.402216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6977c-f79f-4769-afef-360344ba66fc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.402485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6977c-f79f-4769-afef-360344ba66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.420483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b3a6977c-f79f-4769-afef-360344ba66fc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:26.421674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b3a6977c-f79f-4769-afef-360344ba66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:26.487378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 162/322] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:26.510309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfcf4a-40a6-4157-abab-d3f51cbd4334 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:26.532190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d243-a579-4cb3-bdea-3a5c27228403 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.532475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d243-a579-4cb3-bdea-3a5c27228403 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.532747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d243-a579-4cb3-bdea-3a5c27228403 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.534231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 163/323] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:26.538977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80823b-7fe2-4987-9e8c-804cff2549e1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.539256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80823b-7fe2-4987-9e8c-804cff2549e1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.539527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80823b-7fe2-4987-9e8c-804cff2549e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.552423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:26.559441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2a80823b-7fe2-4987-9e8c-804cff2549e1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:26.560603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2a80823b-7fe2-4987-9e8c-804cff2549e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:26.625386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfcf4a-40a6-4157-abab-d3f51cbd4334 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:26.633798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 164/324] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:26.660612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:26.661144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.661566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.661837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.662909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:26.664309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:26.669540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 161/325] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:26.671313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80823b-7fe2-4987-9e8c-804cff2549e1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:26.674511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:26.751079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:26.773745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80823b-7fe2-4987-9e8c-804cff2549e1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:26.809727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:26.810327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.810599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.810871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] PATH_INFO: `/v3/groups` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.811492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:26.812895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:26.841539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 165/326] 10.222.0.69 () {60 vars in 1134 bytes} [Tue Aug 30 04:03:26 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:26.868716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b025-356d-4a1c-b50f-40ae34256185 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:26.879329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:26.905415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:26.909701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:26.910348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.910678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.910891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.922368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:26.928784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:26.930060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:26.930914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 162/327] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:26.936368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:26.982419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:27.029437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c50de2-90d4-4a95-8899-a935b8220cc1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.050327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323167e-f820-4d46-aa85-c1974c3be0b4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.072137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.072137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.072440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.072962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.088723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:27.094181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:27.095616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:27.096817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 166/328] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:27.106503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:27.106666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.107276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.107559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.107833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.108503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:27.108807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:27.110254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:27.120023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 163/329] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:27.126356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:27.165976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:27.248535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa99c51-62c8-4143-85e9-c92c4ac01e02 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.266500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6d4c8-d997-4704-9ff7-a6834e8b856b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.274008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:27.287868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.288541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.288830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.289099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.289883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:27.290461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:27.291555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:27.301994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 167/330] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:27.307231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:27.325646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.326564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.327044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.327604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] PATH_INFO: `/v3/users/234bf4bfa9d643dd82144db74f0139be` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.328995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] RBAC: Authorizing `identity:get_user(user_id=234bf4bfa9d643dd82144db74f0139be)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:27.330596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:27.332859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 164/331] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:27 2022] GET /identity/v3/users/234bf4bfa9d643dd82144db74f0139be => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:27.338832 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:27.421598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc99a62-3945-4cc7-aa34-48af8510c519 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.457707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.458823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.459264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.459815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] PATH_INFO: `/v3/users/2864fe8feb3e425e8fc34646cfc8f6d8` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.461084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:27.461250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] RBAC: Authorizing `identity:get_user(user_id=2864fe8feb3e425e8fc34646cfc8f6d8)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:27.463709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:27.466257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 168/332] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:27 2022] GET /identity/v3/users/2864fe8feb3e425e8fc34646cfc8f6d8 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:27.469331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355faad-f2b5-4bc0-9d17-e8f50eeaf26b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.473942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:27.512012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627f5a-2f73-49f6-97b4-fbf55cb179b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.512780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627f5a-2f73-49f6-97b4-fbf55cb179b8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.513176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627f5a-2f73-49f6-97b4-fbf55cb179b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.513576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627f5a-2f73-49f6-97b4-fbf55cb179b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.514497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627f5a-2f73-49f6-97b4-fbf55cb179b8 None admin] RBAC: Adding query filter params (role.id=d42a0cb1e08a4202a168c7707fdef7fd, user.id=234bf4bfa9d643dd82144db74f0139be, scope.system=all) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:27.514859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627f5a-2f73-49f6-97b4-fbf55cb179b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:27.516408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627f5a-2f73-49f6-97b4-fbf55cb179b8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:27.533232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 165/333] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 30 04:03:27 2022] GET /identity/v3/role_assignments?user.id=234bf4bfa9d643dd82144db74f0139be&scope.system=all&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:27.546002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:27.609817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af5577-43f4-43cc-a1a9-b5d617a2c1ad None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.650915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa87a7-5bab-42e9-8298-a3989ac0952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.651819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa87a7-5bab-42e9-8298-a3989ac0952e None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.652261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa87a7-5bab-42e9-8298-a3989ac0952e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.652670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa87a7-5bab-42e9-8298-a3989ac0952e None admin] PATH_INFO: `/v3/system/users/2864fe8feb3e425e8fc34646cfc8f6d8/roles/a99b0b2224eb415c968f6b7cb9de902a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.654402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa87a7-5bab-42e9-8298-a3989ac0952e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2864fe8feb3e425e8fc34646cfc8f6d8, role_id=a99b0b2224eb415c968f6b7cb9de902a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:27.655941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa87a7-5bab-42e9-8298-a3989ac0952e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:27.668451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 169/334] 10.222.0.69 () {58 vars in 1334 bytes} [Tue Aug 30 04:03:27 2022] PUT /identity/v3/system/users/2864fe8feb3e425e8fc34646cfc8f6d8/roles/a99b0b2224eb415c968f6b7cb9de902a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:28.945316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373c3e-2df5-41c7-9ed0-522998e48dc4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:28.945876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373c3e-2df5-41c7-9ed0-522998e48dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:28.946330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373c3e-2df5-41c7-9ed0-522998e48dc4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:28.948106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 166/335] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:28.953156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5f23-a9ed-4dcb-a994-a10732e7e239 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:28.953646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5f23-a9ed-4dcb-a994-a10732e7e239 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:28.953737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5f23-a9ed-4dcb-a994-a10732e7e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:28.979680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d92f5f23-a9ed-4dcb-a994-a10732e7e239 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:28.980904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d92f5f23-a9ed-4dcb-a994-a10732e7e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:29.072420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 170/336] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:29.241033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553d1d-9c1e-44d9-9f69-cb64e7326c63 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:29.241324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553d1d-9c1e-44d9-9f69-cb64e7326c63 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:29.241528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553d1d-9c1e-44d9-9f69-cb64e7326c63 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:29.242873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 167/337] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:29.259507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf548d7-7380-4c9c-96a7-09061f642408 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:29.259806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf548d7-7380-4c9c-96a7-09061f642408 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:29.260050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf548d7-7380-4c9c-96a7-09061f642408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:29.281834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bcf548d7-7380-4c9c-96a7-09061f642408 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:29.283548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bcf548d7-7380-4c9c-96a7-09061f642408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:29.334814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:29.365596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 171/338] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:29.559481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553d1d-9c1e-44d9-9f69-cb64e7326c63 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:29.706854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553d1d-9c1e-44d9-9f69-cb64e7326c63 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:29.748170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:29.748801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:29.749075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:29.749342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:29.760761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:29.765686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:29.766560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:29.767881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 168/339] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:29.778618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf548d7-7380-4c9c-96a7-09061f642408 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:29.929314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf548d7-7380-4c9c-96a7-09061f642408 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:29.979721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:29.980475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:29.980652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:29.980852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:29.981543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:29.981841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:29.983212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:29.987110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:29.993534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 172/340] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:29.999139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:30.014741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:30.083997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:30.170203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05451d-9154-44c4-b0c1-e24b0671e40d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:30.230183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75193c9f-22b8-45b8-bb59-7f29698f8653 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:30.231118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:30.231763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.232044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.232312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.256858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:30.262648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:30.263537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:30.264322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:30.268981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 169/341] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:30.270028 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:30.299231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723379de-ef7e-433d-a81b-7d2f7902f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:30.300143 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723379de-ef7e-433d-a81b-7d2f7902f56c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.300589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723379de-ef7e-433d-a81b-7d2f7902f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.301023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723379de-ef7e-433d-a81b-7d2f7902f56c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.382604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:30.409027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723379de-ef7e-433d-a81b-7d2f7902f56c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:30.410539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723379de-ef7e-433d-a81b-7d2f7902f56c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:30.410915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf304f28-0223-4e6c-936b-ee914f9ca036 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:30.447394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8daf79-ca55-49cb-a3f1-d700b027cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:30.448010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8daf79-ca55-49cb-a3f1-d700b027cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.448285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8daf79-ca55-49cb-a3f1-d700b027cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.448556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8daf79-ca55-49cb-a3f1-d700b027cbf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.449228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8daf79-ca55-49cb-a3f1-d700b027cbf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:30.449551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8daf79-ca55-49cb-a3f1-d700b027cbf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:30.451073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8daf79-ca55-49cb-a3f1-d700b027cbf1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:30.452168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:30.460050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 170/342] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:30.465778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0fab6-ac97-4d68-9b02-351f00eaabfb None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.466078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0fab6-ac97-4d68-9b02-351f00eaabfb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.466357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0fab6-ac97-4d68-9b02-351f00eaabfb None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.467683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 171/343] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:30.468742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209c11-cec8-4163-a453-2ee2feda37d0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.469020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209c11-cec8-4163-a453-2ee2feda37d0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.469290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209c11-cec8-4163-a453-2ee2feda37d0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.470578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 172/344] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:30.479818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58dbbe-1c88-486d-bf57-7f6e234a0c15 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.480108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58dbbe-1c88-486d-bf57-7f6e234a0c15 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.480434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58dbbe-1c88-486d-bf57-7f6e234a0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.501139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fa58dbbe-1c88-486d-bf57-7f6e234a0c15 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:30.502784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fa58dbbe-1c88-486d-bf57-7f6e234a0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:30.519362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 173/345] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:30.520737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab11eb-6504-4208-b51d-d4188899faaf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.521026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab11eb-6504-4208-b51d-d4188899faaf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.521301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab11eb-6504-4208-b51d-d4188899faaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.540338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-57ab11eb-6504-4208-b51d-d4188899faaf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:30.541568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-57ab11eb-6504-4208-b51d-d4188899faaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:30.578620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 173/346] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:30.579674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58dbbe-1c88-486d-bf57-7f6e234a0c15 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:30.637501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 174/347] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:30.638461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab11eb-6504-4208-b51d-d4188899faaf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:30.710319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:30.736120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:30.752027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab11eb-6504-4208-b51d-d4188899faaf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:30.794406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:30.795048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.795326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.795594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.799165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:30.800605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:30.802455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 175/348] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:30 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:30.808006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:30.809270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58dbbe-1c88-486d-bf57-7f6e234a0c15 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:30.877584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ec73a-f247-4bdb-b7dd-0ad864956252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:30.878203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec73a-f247-4bdb-b7dd-0ad864956252 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:30.878476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec73a-f247-4bdb-b7dd-0ad864956252 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:30.878744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ec73a-f247-4bdb-b7dd-0ad864956252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:30.958176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e44c7-d8d8-400b-b121-5eeff6c68272 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.012509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ec73a-f247-4bdb-b7dd-0ad864956252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:31.013947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ec73a-f247-4bdb-b7dd-0ad864956252 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:31.043110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447e73e-7dee-42b2-ab56-969d74226e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.044422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447e73e-7dee-42b2-ab56-969d74226e1a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.044907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447e73e-7dee-42b2-ab56-969d74226e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.045363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447e73e-7dee-42b2-ab56-969d74226e1a None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.057542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:31.058384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447e73e-7dee-42b2-ab56-969d74226e1a None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:31.060005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447e73e-7dee-42b2-ab56-969d74226e1a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:31.065727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 176/349] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:30 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:31.067230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237442-f14b-4732-a440-9bf15ef9fbad None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.067701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237442-f14b-4732-a440-9bf15ef9fbad None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.068160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237442-f14b-4732-a440-9bf15ef9fbad None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.075254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 177/350] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:31.076241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237442-f14b-4732-a440-9bf15ef9fbad None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.097607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:31.121111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 174/351] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:31.122397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ceb62-01c0-4807-bd6e-40eba2052140 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.122678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ceb62-01c0-4807-bd6e-40eba2052140 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.122947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ceb62-01c0-4807-bd6e-40eba2052140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.160801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-221ceb62-01c0-4807-bd6e-40eba2052140 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:31.162022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-221ceb62-01c0-4807-bd6e-40eba2052140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:31.243619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 175/352] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:31.244481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ceb62-01c0-4807-bd6e-40eba2052140 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.261143 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237442-f14b-4732-a440-9bf15ef9fbad None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.310324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.311268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.311954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.312220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.312962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:31.313263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:31.315150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:31.325444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 178/353] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:31.326347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.393007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ceb62-01c0-4807-bd6e-40eba2052140 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.402933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:31.405931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:31.441405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.444842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.445591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.446073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.447811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:31.449466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:31.450853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb38d8-a911-4b70-acda-3a297df22fb6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.451590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 176/354] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:31.452790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.507782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.508397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.508671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.508933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.531745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:31.537876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:31.538841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:31.539656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 179/355] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:31.540358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.613538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f3267-f57e-437c-9760-86e6af41226e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.656098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.656731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.657006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.657272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.668322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:31.674223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:31.675130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:31.675938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 177/356] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:31.676598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.706425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:31.710152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4e58-f759-4753-8112-a9c93d460923 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.736409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:31.754478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.755187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.755387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.755656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.756774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:31.758238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:31.759816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 180/357] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:31.760569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.816136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d295c37-e783-46fd-b4c7-8d64e799d985 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.873012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.873982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.874457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.874917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.875752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:31.876747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:31.878356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:31.891777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f7210-4038-42a5-9f69-8a6ff4f503e5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:31.894457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 178/358] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:31.895100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:31.940806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3de8c-9cee-497b-b117-dacb3564a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:31.941227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3de8c-9cee-497b-b117-dacb3564a1fb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.942148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3de8c-9cee-497b-b117-dacb3564a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.942429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3de8c-9cee-497b-b117-dacb3564a1fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.964931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3de8c-9cee-497b-b117-dacb3564a1fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-58a3de8c-9cee-497b-b117-dacb3564a1fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:31.971586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:31.972625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 181/359] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:31.974337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698290c2-6276-4f60-a883-4655f0a3deb5 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:31.975061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698290c2-6276-4f60-a883-4655f0a3deb5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:31.975061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698290c2-6276-4f60-a883-4655f0a3deb5 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:31.976651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 182/360] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:31.976651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698290c2-6276-4f60-a883-4655f0a3deb5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:32.008845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.028383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6afaf4-bc95-4eda-92f5-9703c816c829 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:32.055063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.080580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:32.081248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.081582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.082420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.083089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:32.083462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:32.085769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:32.098100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 179/361] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:32.099782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:32.113849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698290c2-6276-4f60-a883-4655f0a3deb5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:32.154163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:32.155105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.155580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.156045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.156976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:32.157636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:32.159271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:32.166188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 183/362] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:31 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:32.167291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:32.237759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bcce9-7539-47fc-a0be-6cc1da4be8e3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:32.279573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:32.280188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.280465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.280738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.303651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.321420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e909f6c-2026-46f0-9350-d1a1bca454df None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:32.343873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.368728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b84525-3b90-4c5c-a406-dcb4c8de1d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:32.369456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b84525-3b90-4c5c-a406-dcb4c8de1d14 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.369854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b84525-3b90-4c5c-a406-dcb4c8de1d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.370692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b84525-3b90-4c5c-a406-dcb4c8de1d14 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.371610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b84525-3b90-4c5c-a406-dcb4c8de1d14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:32.372250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b84525-3b90-4c5c-a406-dcb4c8de1d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:32.373039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:32.373783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b84525-3b90-4c5c-a406-dcb4c8de1d14 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:32.375012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:32.384723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 184/363] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:32.386233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b39a5-77ea-4141-8a21-3a54e0869797 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.389927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b39a5-77ea-4141-8a21-3a54e0869797 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.391169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b39a5-77ea-4141-8a21-3a54e0869797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.411834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-dd3b39a5-77ea-4141-8a21-3a54e0869797 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:32.413417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dd3b39a5-77ea-4141-8a21-3a54e0869797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:32.492569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 180/364] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:32.493775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:32.513896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 185/365] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:32.515093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b39a5-77ea-4141-8a21-3a54e0869797 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:32.596346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.634918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b39a5-77ea-4141-8a21-3a54e0869797 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:32.648138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.681781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:32.682672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.683151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.683653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.702371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce7124-33c5-40c8-905b-123dcd959524 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:32.778308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:32.780530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.782304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.783313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] PATH_INFO: `/v3/users/2864fe8feb3e425e8fc34646cfc8f6d8` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.785650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] RBAC: Authorizing `identity:get_user(user_id=2864fe8feb3e425e8fc34646cfc8f6d8)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:32.790308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:32.794248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 181/366] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:03:32 2022] GET /identity/v3/users/2864fe8feb3e425e8fc34646cfc8f6d8 => generated 293 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:32.795287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:32.825762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:32.828596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:32.961151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ed148-8f2e-4b76-8772-59448c570b22 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:32.980961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.993659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 186/367] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:32.996081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.011667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.014944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.015794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.016226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.017324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.019702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.021292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.023154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 182/368] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:32 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.024087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.114493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a613d6e-8473-409d-b1cc-60ad59847f3c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.137270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a16ec1-cde4-46a2-b3f8-18e3b88e97ac None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.153502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.154227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.154581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.154919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.155712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] RBAC: Adding query filter params (role.id=a99b0b2224eb415c968f6b7cb9de902a, user.id=2864fe8feb3e425e8fc34646cfc8f6d8, scope.system=all) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:33.156085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.157674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.171098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 187/369] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 30 04:03:32 2022] GET /identity/v3/role_assignments?user.id=2864fe8feb3e425e8fc34646cfc8f6d8&scope.system=all&role.id=a99b0b2224eb415c968f6b7cb9de902a => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.172167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.180487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.181495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.181971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.182475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.196434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:33.202332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:33.203297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:33.204127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:33.207131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 183/370] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:33.208104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.250163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.272152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.295945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5a10-2230-44c0-9128-1e0ed5dc2197 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.334462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.335196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.335549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.335895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.337334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.339090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.340159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4376a5-8864-4f70-bd23-b3f4ef1215fa None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.341118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 188/371] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.344163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.388019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.389040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.389488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.389984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.391399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.393721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.395883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 184/372] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.397102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.452894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2febc-15f2-4c10-9be9-a3e831455af5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.517853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.518800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.519273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.520175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.521300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:33.521822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.522530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dcc90-8f51-45e9-8822-7af2c47db82c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.523592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.525596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.538126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 189/373] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.539513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.540506 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.571174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.571815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.572091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.572360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.573963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.575521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.581665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 185/374] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.582583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.698136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c7354-d810-4ac2-a0df-d7029e3b23cd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.708076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d01c6-3acf-40f3-bc52-a02a1b3cd7a7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.747296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.748492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.749302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.749911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.751021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=16690e877c4045de897434640f593aad) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:33.751505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.751632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.752328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.752689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.753045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.753843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.761387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 190/375] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=16690e877c4045de897434640f593aad&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.762556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:33.830496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.852964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.862240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.863796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.915656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826bb13-9644-425f-a169-a7ae4a0f2afd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.966095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295116c9-bfbd-47b9-9115-5efbe0b54632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.966701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295116c9-bfbd-47b9-9115-5efbe0b54632 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.966974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295116c9-bfbd-47b9-9115-5efbe0b54632 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.967245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295116c9-bfbd-47b9-9115-5efbe0b54632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.967969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295116c9-bfbd-47b9-9115-5efbe0b54632 None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=16690e877c4045de897434640f593aad) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:33.968269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295116c9-bfbd-47b9-9115-5efbe0b54632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.969839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295116c9-bfbd-47b9-9115-5efbe0b54632 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.975589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 191/376] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=16690e877c4045de897434640f593aad&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:33.976964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4c2d-7e51-484a-a7c9-e9acfa4fe056 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.977244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4c2d-7e51-484a-a7c9-e9acfa4fe056 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.977536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4c2d-7e51-484a-a7c9-e9acfa4fe056 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.980025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 192/377] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:33.985352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a31c-0aca-47bd-9fa1-15e9fef4a722 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.985713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a31c-0aca-47bd-9fa1-15e9fef4a722 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.985983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a31c-0aca-47bd-9fa1-15e9fef4a722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.005541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d320a31c-0aca-47bd-9fa1-15e9fef4a722 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:34.007353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d320a31c-0aca-47bd-9fa1-15e9fef4a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:34.031936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 186/378] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:34.042257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:34.119319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 193/379] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:34.172692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:34.198602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f17f-6e3d-4eb3-9b7f-239072f32a82 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:34.236365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:34.236993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:34.237323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:34.237622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] PATH_INFO: `/v3/projects/182d1898255a432ebd2d97be00a98e9d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.239512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] RBAC: Authorizing `identity:get_project(project_id=182d1898255a432ebd2d97be00a98e9d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:34.241124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:34.243101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 187/380] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:34 2022] GET /identity/v3/projects/182d1898255a432ebd2d97be00a98e9d => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:34.248662 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a31c-0aca-47bd-9fa1-15e9fef4a722 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:34.309330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:34.359901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a31c-0aca-47bd-9fa1-15e9fef4a722 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:34.396972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:34.397539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:34.397825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:34.398091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] PATH_INFO: `/v3/groups/e8c687f6a76c403d917e46639047a9d7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.403263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] RBAC: Authorizing `identity:get_group(group_id=e8c687f6a76c403d917e46639047a9d7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:34.404699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:34.406607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 194/381] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:34 2022] GET /identity/v3/groups/e8c687f6a76c403d917e46639047a9d7 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:34.412470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:34.491079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:34.537673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00b85-5e93-49f2-957e-18be5412b738 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:34.595969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325baf9-3d3c-468d-abee-09e0fdf41c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:34.595969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325baf9-3d3c-468d-abee-09e0fdf41c01 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:34.596335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325baf9-3d3c-468d-abee-09e0fdf41c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:34.596495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325baf9-3d3c-468d-abee-09e0fdf41c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.597785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325baf9-3d3c-468d-abee-09e0fdf41c01 None admin] RBAC: Adding query filter params (group.id=e8c687f6a76c403d917e46639047a9d7, role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=182d1898255a432ebd2d97be00a98e9d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:34.597785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325baf9-3d3c-468d-abee-09e0fdf41c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:34.598949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325baf9-3d3c-468d-abee-09e0fdf41c01 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:34.607431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 188/382] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:34 2022] GET /identity/v3/role_assignments?group.id=e8c687f6a76c403d917e46639047a9d7&scope.project.id=182d1898255a432ebd2d97be00a98e9d&role.id=108991f8e3774559b4def1c3448e020b => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:34.609284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8477-41d5-49f1-945c-a65fa673cb01 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:34.610267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8477-41d5-49f1-945c-a65fa673cb01 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:34.611501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8477-41d5-49f1-945c-a65fa673cb01 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.618458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 189/383] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:34.620435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb362-d24f-483a-ba85-c3a28c093a6e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:34.620883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb362-d24f-483a-ba85-c3a28c093a6e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:34.621300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb362-d24f-483a-ba85-c3a28c093a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.627721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfaae-02fb-49ac-80cf-32fa3ec16dcf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:34.645310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b78eb362-d24f-483a-ba85-c3a28c093a6e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:34.646834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b78eb362-d24f-483a-ba85-c3a28c093a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:34.650864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:34.659546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:34.681995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:34.683174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:34.684074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:34.684525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.700981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:34.708004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:34.709161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:34.710214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:34.713096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 195/384] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:34.722278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:34.750372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 190/385] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:34.861275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95296787-ceb6-4cbf-9baf-bb6f1c4c7920 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:34.901758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:34.902295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:34.902638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:34.902917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:34.903592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:34.903892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:34.905263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:34.914561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 196/386] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:34.919858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb362-d24f-483a-ba85-c3a28c093a6e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:35.041668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb362-d24f-483a-ba85-c3a28c093a6e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:35.091696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:35.092643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.093110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.093574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.098145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:35.099899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:35.101777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 191/387] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:34 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:35.107292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:35.125626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:35.143877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:35.164468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:35.245276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96828b09-cf03-477f-9ada-41b3f3d9173b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:35.261606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d08b8-ed1c-4107-89a6-c0503a53e46f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:35.283497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:35.284419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.284906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.285348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.296764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:35.312581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:35.313550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:35.314401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:35.316846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 192/388] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:35.324561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:35.364463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:35.365110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.365387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.365683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.370215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:35.371679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:35.373562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 197/389] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:35 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:35.382423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:35.401960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:35.434938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892ccc-4b38-4e10-8a18-6b410b07a341 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:35.480939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:35.481858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.482281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.482692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.483494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:35.483940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:35.485446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:35.495878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 193/390] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:35.506889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:35.634456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa30ca-52e4-4ec9-b321-63401a3e028e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:35.672094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:35.681944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:35.682818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.683120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.683432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.685930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:35.687342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:35.687646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eacc8a-5cbf-40fe-8458-610122cd5ded None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:35.689835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 194/391] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:35 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:35.695179 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:35.712389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:35.774478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:35.775147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.775419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.775687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.779156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a, group_id=29ffe5aee2504b2eb98f317bd7b97bf7, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:35.780608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:35.817552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 198/392] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 30 04:03:35 2022] PUT /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:35.848904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c858-2e4f-4cad-979a-c9c5681fb753 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:35.887422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79b814-606a-454d-b1ae-58b277da6841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:35.888060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b814-606a-454d-b1ae-58b277da6841 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.888340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b814-606a-454d-b1ae-58b277da6841 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.888620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b814-606a-454d-b1ae-58b277da6841 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.889812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79b814-606a-454d-b1ae-58b277da6841 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:35.891302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79b814-606a-454d-b1ae-58b277da6841 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:35.893688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 195/393] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:35 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:35.899168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:36.056204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfc31c-caee-4957-9270-0747b365518a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:36.091664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe190dc7-ae14-4b90-bcbe-8b4254859457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:36.092324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe190dc7-ae14-4b90-bcbe-8b4254859457 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:36.092598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe190dc7-ae14-4b90-bcbe-8b4254859457 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:36.092868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe190dc7-ae14-4b90-bcbe-8b4254859457 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:36.095864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe190dc7-ae14-4b90-bcbe-8b4254859457 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a, group_id=29ffe5aee2504b2eb98f317bd7b97bf7, role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:36.097994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe190dc7-ae14-4b90-bcbe-8b4254859457 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:36.115867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 199/394] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 30 04:03:35 2022] PUT /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:36.231711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5bf82-e74d-4321-bc27-846ac0ec1d1a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:36.232082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5bf82-e74d-4321-bc27-846ac0ec1d1a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:36.232268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5bf82-e74d-4321-bc27-846ac0ec1d1a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:36.233889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 196/395] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:36.239464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9847-57ff-4796-8cb2-d6b053c30cda None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:36.239929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9847-57ff-4796-8cb2-d6b053c30cda None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:36.240023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9847-57ff-4796-8cb2-d6b053c30cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:36.265041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-eb7a9847-57ff-4796-8cb2-d6b053c30cda None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:36.266376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-eb7a9847-57ff-4796-8cb2-d6b053c30cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:36.297923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:36.346735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 200/396] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:36.721799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5bf82-e74d-4321-bc27-846ac0ec1d1a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:36.802059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:36.843028 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5bf82-e74d-4321-bc27-846ac0ec1d1a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:36.888504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dcf20-19aa-4b4d-be63-e49f8f05b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:36.889180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcf20-19aa-4b4d-be63-e49f8f05b6ba None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:36.889457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcf20-19aa-4b4d-be63-e49f8f05b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:36.889746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcf20-19aa-4b4d-be63-e49f8f05b6ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:36.903034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dcf20-19aa-4b4d-be63-e49f8f05b6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ef3dcf20-19aa-4b4d-be63-e49f8f05b6ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:36.908852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:36.909867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:36.910705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 197/397] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:36.916116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a9847-57ff-4796-8cb2-d6b053c30cda None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:36.977351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c89a-6ee0-4f1b-b3fd-d8b4a8624a06 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:36.977351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c89a-6ee0-4f1b-b3fd-d8b4a8624a06 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:36.977351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c89a-6ee0-4f1b-b3fd-d8b4a8624a06 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:36.977351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 198/398] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:36.983789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade3d0e-983c-42ee-bf88-a557a94d7454 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:36.984344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade3d0e-983c-42ee-bf88-a557a94d7454 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:36.984813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade3d0e-983c-42ee-bf88-a557a94d7454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.005160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-aade3d0e-983c-42ee-bf88-a557a94d7454 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:37.006736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aade3d0e-983c-42ee-bf88-a557a94d7454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:37.074183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a9847-57ff-4796-8cb2-d6b053c30cda None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:37.081118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 199/399] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:37.082662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d77a-258a-43df-a3d5-29acb631b772 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.083197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d77a-258a-43df-a3d5-29acb631b772 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.083656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6d77a-258a-43df-a3d5-29acb631b772 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.090977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 200/400] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:37.092549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43632-de3f-46a1-8811-7a3830f82d98 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.093129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43632-de3f-46a1-8811-7a3830f82d98 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.093612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e43632-de3f-46a1-8811-7a3830f82d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.115805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:37.116645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.116991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.117328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.118073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:37.118437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:37.119871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:37.121657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c6e43632-de3f-46a1-8811-7a3830f82d98 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:37.123162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c6e43632-de3f-46a1-8811-7a3830f82d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:37.134754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 201/401] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:37.136175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:37.166276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:37.239413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:37.268515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 201/402] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:37.287740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e7cde-eb59-40bf-8b2f-d8a7ed748947 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:37.338317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:37.339464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.339937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.340363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.345634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:37.347344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:37.349399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 202/403] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:37 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:37.355096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43632-de3f-46a1-8811-7a3830f82d98 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:37.422441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:37.478430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e43632-de3f-46a1-8811-7a3830f82d98 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:37.513996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:37.514896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.515341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.515819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.517791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:37.519505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:37.521650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 202/404] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:37 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:37.527745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:37.591058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:37.638298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:37.640648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf911-d053-4318-99ca-a8d6d4c654cb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:37.652715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102a676-7b18-4897-af8f-9b229ef50b7c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:37.677198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:37.677886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.678162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.678431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.680346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=16690e877c4045de897434640f593aad, group_id=29ffe5aee2504b2eb98f317bd7b97bf7, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:37.681826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:37.691418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:37.692264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.692611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.692952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.699409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 203/405] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 30 04:03:37 2022] PUT /identity/v3/projects/16690e877c4045de897434640f593aad/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:03:37.702235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:37.722279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:37.729625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:37.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:37.731453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:37.738457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 203/406] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:37.739445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:37.890584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b7a2b-8f36-4291-ac10-37e5f7db1c9b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:37.912029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:37.923051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7440b0b-945c-4cc6-8294-dc57b99998f6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:37.940746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:37.941816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.942313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.943409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.955659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:37.961339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:37.962539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:37.963543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:37.964796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:37.965408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:37.965707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:37.965977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:37.966327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 204/407] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:37.966929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:37.967230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:37.968594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:37.975711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:37.989574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 204/408] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:37.995002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:38.019489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:38.163754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f5782-aab9-47a6-9310-d1f441aea69d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:38.190318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14eaa1-295f-4172-9f94-831b6405224f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:38.231991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:38.233390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.234368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.235293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.237900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:38.240050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:38.240862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:38.241712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.243871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.244357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.249531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:38.250135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:38.250638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 205/409] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:37 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:38.252915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:38.255857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:38.274338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 205/410] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:38.280730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:38.349317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:38.433776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fb23f-45bb-4f33-bba6-059a58040541 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:38.435912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:38.462667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f77f-b8c3-4ae6-acad-e8fa7901b1b1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:38.475621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3edb4-127a-4da3-bdca-71dbcf9583b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:38.476593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3edb4-127a-4da3-bdca-71dbcf9583b9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.477125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3edb4-127a-4da3-bdca-71dbcf9583b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.477628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3edb4-127a-4da3-bdca-71dbcf9583b9 None admin] PATH_INFO: `/v3/groups/e8c687f6a76c403d917e46639047a9d7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.479134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3edb4-127a-4da3-bdca-71dbcf9583b9 None admin] RBAC: Authorizing `identity:get_group(group_id=e8c687f6a76c403d917e46639047a9d7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:38.480760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3edb4-127a-4da3-bdca-71dbcf9583b9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:38.483110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 206/411] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:38 2022] GET /identity/v3/groups/e8c687f6a76c403d917e46639047a9d7 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:38.484544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259e674-f981-4d3b-b0ef-6cb034de20dc None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.485092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259e674-f981-4d3b-b0ef-6cb034de20dc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.485641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259e674-f981-4d3b-b0ef-6cb034de20dc None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.487966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 207/412] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:38.488867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259e674-f981-4d3b-b0ef-6cb034de20dc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:38.507448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cf61a-24ae-4fe9-b586-1534b04c9926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:38.508076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cf61a-24ae-4fe9-b586-1534b04c9926 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.508350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cf61a-24ae-4fe9-b586-1534b04c9926 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.508617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cf61a-24ae-4fe9-b586-1534b04c9926 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.509976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cf61a-24ae-4fe9-b586-1534b04c9926 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:38.511801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cf61a-24ae-4fe9-b586-1534b04c9926 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:38.514262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 206/413] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:38 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:38.517653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a2d90-ce3d-4428-b227-d4b8b85f9ac3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.517653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a2d90-ce3d-4428-b227-d4b8b85f9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.517653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a2d90-ce3d-4428-b227-d4b8b85f9ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.535780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-187a2d90-ce3d-4428-b227-d4b8b85f9ac3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:38.537257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-187a2d90-ce3d-4428-b227-d4b8b85f9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:38.617546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 207/414] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:38.617546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a2d90-ce3d-4428-b227-d4b8b85f9ac3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:38.630555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259e674-f981-4d3b-b0ef-6cb034de20dc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:38.640478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:38.677428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116cf6b-2d8e-4761-a279-2b66c2ea26d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:38.678454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116cf6b-2d8e-4761-a279-2b66c2ea26d7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.678796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116cf6b-2d8e-4761-a279-2b66c2ea26d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.679453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116cf6b-2d8e-4761-a279-2b66c2ea26d7 None admin] PATH_INFO: `/v3/projects/182d1898255a432ebd2d97be00a98e9d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.680584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116cf6b-2d8e-4761-a279-2b66c2ea26d7 None admin] RBAC: Authorizing `identity:get_project(project_id=182d1898255a432ebd2d97be00a98e9d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:38.682564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116cf6b-2d8e-4761-a279-2b66c2ea26d7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:38.685089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 208/415] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:38 2022] GET /identity/v3/projects/182d1898255a432ebd2d97be00a98e9d => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:38.686617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4fcd-5a2b-4d53-9153-7c0f90f6fa63 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.686901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4fcd-5a2b-4d53-9153-7c0f90f6fa63 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.687173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c4fcd-5a2b-4d53-9153-7c0f90f6fa63 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.690204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 209/416] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:38.690936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4fcd-5a2b-4d53-9153-7c0f90f6fa63 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:38.716016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:38.741439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a2d90-ce3d-4428-b227-d4b8b85f9ac3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:38.778712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810348b-6712-4e45-b51e-c6e6870ea500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:38.779670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810348b-6712-4e45-b51e-c6e6870ea500 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.779881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810348b-6712-4e45-b51e-c6e6870ea500 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.780164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810348b-6712-4e45-b51e-c6e6870ea500 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.782417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810348b-6712-4e45-b51e-c6e6870ea500 None admin] RBAC: Authorizing `identity:create_grant(project_id=16690e877c4045de897434640f593aad, group_id=29ffe5aee2504b2eb98f317bd7b97bf7, role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:38.784533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810348b-6712-4e45-b51e-c6e6870ea500 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:38.810058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 208/417] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 30 04:03:38 2022] PUT /identity/v3/projects/16690e877c4045de897434640f593aad/groups/29ffe5aee2504b2eb98f317bd7b97bf7/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:38.811525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02b92-4cf2-4832-bc65-2baf323d8992 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.811799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02b92-4cf2-4832-bc65-2baf323d8992 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.812067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02b92-4cf2-4832-bc65-2baf323d8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.831288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c4fcd-5a2b-4d53-9153-7c0f90f6fa63 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:38.856982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-97d02b92-4cf2-4832-bc65-2baf323d8992 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:38.858255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-97d02b92-4cf2-4832-bc65-2baf323d8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:38.878441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:38.879448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.880427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.881007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] PATH_INFO: `/v3/projects/182d1898255a432ebd2d97be00a98e9d/groups/e8c687f6a76c403d917e46639047a9d7/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.883433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] RBAC: Authorizing `identity:create_grant(project_id=182d1898255a432ebd2d97be00a98e9d, group_id=e8c687f6a76c403d917e46639047a9d7, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:38.885252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:38.904296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 210/418] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 30 04:03:38 2022] PUT /identity/v3/projects/182d1898255a432ebd2d97be00a98e9d/groups/e8c687f6a76c403d917e46639047a9d7/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:38.905941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:38.991112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:39.012702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 209/419] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:39.076876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12972d-6d4f-490e-9ad4-493ec30a3d16 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:39.114085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:39.114713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:39.114989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:39.115259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:39.126164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:39.131520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:39.132405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:39.133386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 211/420] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:39.140180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02b92-4cf2-4832-bc65-2baf323d8992 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:39.233160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:39.279454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02b92-4cf2-4832-bc65-2baf323d8992 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:39.327726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:39.328332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:39.328607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:39.328873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:39.330105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] RBAC: Adding query filter params (name=member) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:39.330417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:39.331777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:39.343497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 210/421] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:39.349282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:39.351441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:39.461824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:39.472961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0518941-3875-4d86-8bfa-2a2605d6f0b8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:39.518836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dd81d-ab09-473a-811e-cfeaf9542205 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:39.546323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:39.546854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:39.547132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:39.547404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:39.549588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:39.558647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:39.559697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:39.560168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:39.560629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:39.572736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:39.577870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:39.578756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:39.580120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:39.582834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 211/422] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:39.593246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:39.703882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:39.705893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:39.719329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12bcdb-002e-4df5-9e6f-b93b5612330d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:39.756005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:39.756967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:39.757449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:39.758129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:39.758976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:39.759483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:39.761034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:39.770974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 212/423] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:39.791175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:39.835365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:39.845561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 212/424] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:39.850395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:39.903772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:40.000393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9335-674c-4d70-a250-faed96fb1181 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.009634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bf31a-cf05-4db1-b662-b675c04636c2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.074556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.075193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.075464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.075737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.077446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:40.078909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:40.082115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 213/425] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:39 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:40.085471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9d4d6-2f0c-4b28-b29b-cefcefe8ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.086177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d4d6-2f0c-4b28-b29b-cefcefe8ab75 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.086351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d4d6-2f0c-4b28-b29b-cefcefe8ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.086599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d4d6-2f0c-4b28-b29b-cefcefe8ab75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.087949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:40.167532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:40.183757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9d4d6-2f0c-4b28-b29b-cefcefe8ab75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:40.186081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9d4d6-2f0c-4b28-b29b-cefcefe8ab75 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:40.205767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e879393-5990-44e2-9ef1-ed180cd29bb8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.254709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:40.256578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbaf6cb-c5a6-4758-920d-1cd0049d1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.257296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf6cb-c5a6-4758-920d-1cd0049d1316 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.257665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf6cb-c5a6-4758-920d-1cd0049d1316 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.258001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf6cb-c5a6-4758-920d-1cd0049d1316 None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.259688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbaf6cb-c5a6-4758-920d-1cd0049d1316 None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:40.261617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbaf6cb-c5a6-4758-920d-1cd0049d1316 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:40.264369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 214/426] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:40 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:40.265804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3c43-0889-414f-abd9-a780222c9a28 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.266152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3c43-0889-414f-abd9-a780222c9a28 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.266504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f3c43-0889-414f-abd9-a780222c9a28 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.268450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 215/427] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:40.273661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3c43-0889-414f-abd9-a780222c9a28 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:40.320472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 213/428] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:40.322376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f797d52-44d8-442e-bd2e-51eb4bb7a2b2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.322873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f797d52-44d8-442e-bd2e-51eb4bb7a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.323314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f797d52-44d8-442e-bd2e-51eb4bb7a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.341841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5f797d52-44d8-442e-bd2e-51eb4bb7a2b2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:40.343267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5f797d52-44d8-442e-bd2e-51eb4bb7a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:40.397235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f3c43-0889-414f-abd9-a780222c9a28 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.419769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 214/429] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:40.420640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f797d52-44d8-442e-bd2e-51eb4bb7a2b2 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:40.450635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:40.463423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.464607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.465091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.465614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.466732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:40.467242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:40.468918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:40.480680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 216/430] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:40 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:40.543425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:40.570087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f797d52-44d8-442e-bd2e-51eb4bb7a2b2 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.624954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.625538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.625824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.626095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] PATH_INFO: `/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.627289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc8f6bd4a6f47f6b48d82008c85b91a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:40.628711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:40.630711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 215/431] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:40 2022] GET /identity/v3/projects/8fc8f6bd4a6f47f6b48d82008c85b91a => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:40.636268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:40.771710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace366-bad7-416f-83b3-43a9d69392ce None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.804652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:40.812047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.812679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.812956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.813227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.814415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:40.815949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:40.817860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 217/432] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:40 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:40.826677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:40.895545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:40.939902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5893e-c032-465d-a79c-21e164c22401 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.944257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca8b94-0b08-491c-8cc6-60d0a093b7a6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:40.977423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.978523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.979108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.979572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.980513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:40.981048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:40.982274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b22d5-b74a-4191-91fa-2b771ee79b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:40.982830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:40.983122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b22d5-b74a-4191-91fa-2b771ee79b7d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:40.983492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b22d5-b74a-4191-91fa-2b771ee79b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:40.983855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b22d5-b74a-4191-91fa-2b771ee79b7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:40.990273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 218/433] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:40 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=8fc8f6bd4a6f47f6b48d82008c85b91a&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:40.996301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b22d5-b74a-4191-91fa-2b771ee79b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-c64b22d5-b74a-4191-91fa-2b771ee79b7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:41.001477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:41.002455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:41.003236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 216/434] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:41.009109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.090247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e501f-191e-4e3e-84bd-7b7075072b23 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.090528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e501f-191e-4e3e-84bd-7b7075072b23 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.090799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e501f-191e-4e3e-84bd-7b7075072b23 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.092318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 217/435] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:41.098496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd4cc-9b04-4472-9828-0c19963a47a6 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.099090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd4cc-9b04-4472-9828-0c19963a47a6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.099567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd4cc-9b04-4472-9828-0c19963a47a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.122400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-04afd4cc-9b04-4472-9828-0c19963a47a6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:41.123999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-04afd4cc-9b04-4472-9828-0c19963a47a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:41.128667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:41.138081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a8ba4-019d-43a7-af81-affdf2f88307 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.169154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:41.183774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22675629-5eac-4da5-bd07-868738e1d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:41.184576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675629-5eac-4da5-bd07-868738e1d57a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.184723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675629-5eac-4da5-bd07-868738e1d57a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.184912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22675629-5eac-4da5-bd07-868738e1d57a None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.185735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22675629-5eac-4da5-bd07-868738e1d57a None admin] RBAC: Adding query filter params (name=member) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:41.186042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22675629-5eac-4da5-bd07-868738e1d57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:41.187411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22675629-5eac-4da5-bd07-868738e1d57a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:41.196141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 219/436] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:41.197441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d70e-2d1a-4258-8d65-33ba8f752a87 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.197775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d70e-2d1a-4258-8d65-33ba8f752a87 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.198050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350d70e-2d1a-4258-8d65-33ba8f752a87 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.199513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 220/437] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:41.201935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350d70e-2d1a-4258-8d65-33ba8f752a87 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.219733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 218/438] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:41.221566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921cd6-7e19-402d-a1a7-0d4a2779609e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.221853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921cd6-7e19-402d-a1a7-0d4a2779609e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.222127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921cd6-7e19-402d-a1a7-0d4a2779609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.242631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c3921cd6-7e19-402d-a1a7-0d4a2779609e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:41.243822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c3921cd6-7e19-402d-a1a7-0d4a2779609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:41.343289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350d70e-2d1a-4258-8d65-33ba8f752a87 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.345869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 219/439] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:41.380801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:41.381402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.381706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.381975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.441863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:41.455484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:41.456958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:41.504283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921cd6-7e19-402d-a1a7-0d4a2779609e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.574772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 221/440] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:41.581142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.595573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:41.633178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921cd6-7e19-402d-a1a7-0d4a2779609e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.667883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:41.668546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.668821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.669097 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.671917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:41.679681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:41.684024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045bf08-6ca5-4496-a714-01ce21c47547 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:41.684595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:41.685672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:41.686505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:41.689676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 220/441] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:41.690647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.717973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:41.718517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.718784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.719054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.720144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:41.721822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:41.723431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 222/442] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:41.724165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.791001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17dcc3-62b9-499d-87b6-0c7a83533f68 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.816626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:41.820414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59be2a-de74-4b97-a973-521cc0cdc7df None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.824814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:41.825435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.825732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.825997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.835806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:41.841378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:41.842572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:41.843368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 221/443] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:41.844038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.856021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:41.856618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.856895 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.857165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.857853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:41.858152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:41.859494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:41.867768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 223/444] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:41.868530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:41.886788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:41.948282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24194-c989-4ab2-b050-429142144aa4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.969012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba31ab-5a62-49e0-8d99-e589a12177cf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:41.981555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:41.982165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.982435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.982701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.983787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:41.985238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:41.986825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 222/445] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:41.987570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.005032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.005655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.005937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.006216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.006868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:42.007169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.008528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.016362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 224/446] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:42.017669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.049780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.096484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be81ceb-0aa8-4dbf-b209-093a8318db39 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.098337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.117752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df029ff-bf5c-4cf6-bfb0-d1fdd753cdb9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.129825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.130427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.130705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.130979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.157461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.158084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.158365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.158635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.159355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=d42a0cb1e08a4202a168c7707fdef7fd, scope.project.id=16690e877c4045de897434640f593aad) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:42.159659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.161064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.166674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 225/447] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=16690e877c4045de897434640f593aad&role.id=d42a0cb1e08a4202a168c7707fdef7fd => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:42.167517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.211632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.213226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.275386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.291202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bd03c-e183-4508-9f92-e3da4f20bfce None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.329335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.330516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.330796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.331064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.334287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 223/448] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:42.340107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.350944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.415904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.417363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.453533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52484d-aa69-4d26-a348-c303b025b356 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.495813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.496482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.496768 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.497036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] PATH_INFO: `/v3/projects/16690e877c4045de897434640f593aad` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.498210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] RBAC: Authorizing `identity:get_project(project_id=16690e877c4045de897434640f593aad)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.499793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.502296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 224/449] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/projects/16690e877c4045de897434640f593aad => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:42.507556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.533475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.539085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 226/450] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:42.544870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.592572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.612775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1583e-3347-4abf-aca7-de84ba850e66 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.646329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.646877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143d175-b8a4-4453-8429-cce58419b058 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.646980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.647213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.647482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] PATH_INFO: `/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.648618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] RBAC: Authorizing `identity:get_group(group_id=29ffe5aee2504b2eb98f317bd7b97bf7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.650100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.651665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 225/451] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/groups/29ffe5aee2504b2eb98f317bd7b97bf7 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:42.657359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.681254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.681885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.682158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.682423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] PATH_INFO: `/v3/projects/182d1898255a432ebd2d97be00a98e9d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.683521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] RBAC: Authorizing `identity:get_project(project_id=182d1898255a432ebd2d97be00a98e9d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.684951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.686592 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 227/452] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/projects/182d1898255a432ebd2d97be00a98e9d => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:42.692514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.756813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.765706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655e66b-90c6-4c18-b9e1-3c58f458e22d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.799300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a8ff-e5be-4d7f-87e6-242d3e2c6930 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.799731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.800325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.800602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.800869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.801624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] RBAC: Adding query filter params (group.id=29ffe5aee2504b2eb98f317bd7b97bf7, role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=16690e877c4045de897434640f593aad) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:42.801931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.803354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.809052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 226/453] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/role_assignments?group.id=29ffe5aee2504b2eb98f317bd7b97bf7&scope.project.id=16690e877c4045de897434640f593aad&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:42.812289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.835039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9905b5c-e8be-4d46-b9d8-63c7c983b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.835681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905b5c-e8be-4d46-b9d8-63c7c983b6cc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.835954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905b5c-e8be-4d46-b9d8-63c7c983b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.836222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905b5c-e8be-4d46-b9d8-63c7c983b6cc None admin] PATH_INFO: `/v3/groups/e8c687f6a76c403d917e46639047a9d7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.837384 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9905b5c-e8be-4d46-b9d8-63c7c983b6cc None admin] RBAC: Authorizing `identity:get_group(group_id=e8c687f6a76c403d917e46639047a9d7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.838867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9905b5c-e8be-4d46-b9d8-63c7c983b6cc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.840767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 228/454] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/groups/e8c687f6a76c403d917e46639047a9d7 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:42.847338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.951928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1b17c-cb68-41ff-9924-80566c09d2fd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.985556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e928-554d-4d0a-ab38-70c7ea109083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.986705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e928-554d-4d0a-ab38-70c7ea109083 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.986982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e928-554d-4d0a-ab38-70c7ea109083 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.987248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e928-554d-4d0a-ab38-70c7ea109083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.987970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6e928-554d-4d0a-ab38-70c7ea109083 None admin] RBAC: Adding query filter params (group.id=e8c687f6a76c403d917e46639047a9d7, role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=182d1898255a432ebd2d97be00a98e9d) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:42.988277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6e928-554d-4d0a-ab38-70c7ea109083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.989731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6e928-554d-4d0a-ab38-70c7ea109083 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.995460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 227/455] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/role_assignments?group.id=e8c687f6a76c403d917e46639047a9d7&scope.project.id=182d1898255a432ebd2d97be00a98e9d&role.id=108991f8e3774559b4def1c3448e020b => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:45.396336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa2a30-8c89-4828-b565-74ffd429e34d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:45.397328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa2a30-8c89-4828-b565-74ffd429e34d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:45.397897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa2a30-8c89-4828-b565-74ffd429e34d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:45.399713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 229/456] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:45.404661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b61bf-1934-4dfc-ab9f-bccd85f8a28a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:45.405478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b61bf-1934-4dfc-ab9f-bccd85f8a28a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:45.405986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b61bf-1934-4dfc-ab9f-bccd85f8a28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:45.430512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c91b61bf-1934-4dfc-ab9f-bccd85f8a28a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:45.432062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c91b61bf-1934-4dfc-ab9f-bccd85f8a28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:45.450569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:45.523692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 228/457] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:45.655307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c99c-137e-45f6-98e0-6aded5c23213 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:45.655905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c99c-137e-45f6-98e0-6aded5c23213 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:45.656389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c99c-137e-45f6-98e0-6aded5c23213 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:45.658788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 230/458] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:45.663570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dd4b-d739-4299-ac19-da24cd689307 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:45.664076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dd4b-d739-4299-ac19-da24cd689307 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:45.664543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dd4b-d739-4299-ac19-da24cd689307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:45.686535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-90b1dd4b-d739-4299-ac19-da24cd689307 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:45.688076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-90b1dd4b-d739-4299-ac19-da24cd689307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:45.691124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82788c-7839-4fee-801d-bcf4f7dce4a9 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:45.691616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82788c-7839-4fee-801d-bcf4f7dce4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:45.692081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82788c-7839-4fee-801d-bcf4f7dce4a9 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:45.693619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 231/459] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:45.698515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d898e7-5ad5-4668-ba7d-12cb826dde6f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:45.698800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d898e7-5ad5-4668-ba7d-12cb826dde6f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:45.699064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d898e7-5ad5-4668-ba7d-12cb826dde6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:45.726704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-41d898e7-5ad5-4668-ba7d-12cb826dde6f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:45.729032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-41d898e7-5ad5-4668-ba7d-12cb826dde6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:45.817601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 229/460] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:45.855770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 232/461] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:45.874295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1dd4b-d739-4299-ac19-da24cd689307 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:45.970678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:45.997204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1dd4b-d739-4299-ac19-da24cd689307 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.048261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.048954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.049226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.049491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.066075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.067538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:46.093320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:46.094303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:46.095160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:46.095160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.095160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:46.095160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 230/462] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:46.100139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ca69-9fda-4836-bf7f-ce09c721e1d7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.100410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ca69-9fda-4836-bf7f-ce09c721e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.100681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ca69-9fda-4836-bf7f-ce09c721e1d7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.102196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 233/463] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:46.103086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.108468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c5817-cd7b-4a21-a50d-d7f22449fc14 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.108822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c5817-cd7b-4a21-a50d-d7f22449fc14 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.109088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c5817-cd7b-4a21-a50d-d7f22449fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.141211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-703c5817-cd7b-4a21-a50d-d7f22449fc14 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:46.143845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-703c5817-cd7b-4a21-a50d-d7f22449fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:46.222203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 234/464] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:46.223091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c5817-cd7b-4a21-a50d-d7f22449fc14 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.250971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39b07-e16f-4a89-96f5-6b1e9a19da49 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.266448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:46.293119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:46.300648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.301287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.301604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.301879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.302524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:46.302835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.304799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.322418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 231/465] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:46.323612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.330678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c5817-cd7b-4a21-a50d-d7f22449fc14 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.368672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.369391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.369893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.370165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.383630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.385634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:46.403829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:46.406738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:46.408846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:46.408846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.408846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:46.408846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 235/466] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:46.408846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.471282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e591d-2db8-4478-a5fe-4b7ee8e48598 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.513316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.514197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.514613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.515017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.522650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:46.526334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.527975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.532348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92306-ed8c-4c6f-bed3-4cf7f19b0fb8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:46.544203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:46.545248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:46.546436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:46.546436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.546436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:46.550999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 232/467] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:46.551727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.568418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.569041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.569333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.569654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.570296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.571718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.599822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 236/468] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:46 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:46.609754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:46.610913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.674196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a135-02bf-4e6b-929e-2e50482d4295 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.715850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.716470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.716747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.717017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.717710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:46.718012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.719465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.730502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa512-7e27-4c77-bf1a-d585f80abbc1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.733430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 233/469] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:46.734208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.769982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.770524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.770800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.771088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.785241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.787020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.797642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:46.808472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:46.809458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:46.811333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:46.811333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:46.811333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:46.811333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 237/470] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:46.811913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.873896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1069d-8c2a-4cd6-a5f7-a5044fc72efb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.878591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:46.926873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.928088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.928883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.929664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.930495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:46.931171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.933446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:46.937794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b7f4-f15f-4264-b356-d8b9017e5304 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:46.949917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 234/471] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:46.951321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:46.974572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bcb60-0f3a-4e3c-bdfb-645190219c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:46.975208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bcb60-0f3a-4e3c-bdfb-645190219c0d None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.975510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bcb60-0f3a-4e3c-bdfb-645190219c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.975779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bcb60-0f3a-4e3c-bdfb-645190219c0d None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.976429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bcb60-0f3a-4e3c-bdfb-645190219c0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:46.978226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bcb60-0f3a-4e3c-bdfb-645190219c0d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:47.003150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 238/472] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:46 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:47.004501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1abc6-a85d-4612-b72e-abfc308b75f9 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.004786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1abc6-a85d-4612-b72e-abfc308b75f9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.005052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1abc6-a85d-4612-b72e-abfc308b75f9 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.010992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 239/473] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:47.011943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1abc6-a85d-4612-b72e-abfc308b75f9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:47.071036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d6cbb-0c1a-494c-8dbb-c42dea71b877 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:47.099049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:47.120636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1cbf-ba87-4e30-9f8f-01bc7692900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:47.121830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1cbf-ba87-4e30-9f8f-01bc7692900e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.122305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1cbf-ba87-4e30-9f8f-01bc7692900e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.122813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1cbf-ba87-4e30-9f8f-01bc7692900e None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.123689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1cbf-ba87-4e30-9f8f-01bc7692900e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:47.124193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1cbf-ba87-4e30-9f8f-01bc7692900e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:47.125904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1cbf-ba87-4e30-9f8f-01bc7692900e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:47.145599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 235/474] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:47.147322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e45b0-3188-4600-aa7d-89af3903dbda None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.147808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e45b0-3188-4600-aa7d-89af3903dbda None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.148294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e45b0-3188-4600-aa7d-89af3903dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.170645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-735e45b0-3188-4600-aa7d-89af3903dbda None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:47.171857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1abc6-a85d-4612-b72e-abfc308b75f9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:47.171968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-735e45b0-3188-4600-aa7d-89af3903dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:47.197324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:47.217923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:47.219097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.219379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.219647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.220296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:47.222870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:47.247564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 240/475] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:47 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:47.248717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:47.265281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 236/476] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:47.382477 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411703-b0bb-48cd-ba0f-180ca6d4edb4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:47.399026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:47.430620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:47.431318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.431564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.431834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.432484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:47.434033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:47.483167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 241/477] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:47 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:47.566028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e45b0-3188-4600-aa7d-89af3903dbda None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:47.679184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e45b0-3188-4600-aa7d-89af3903dbda None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:47.715704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:47.716305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.716578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.716847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.717625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:47.718989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:47.727035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.sql.core [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:03:47.727035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 04:03:47.727035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [parameters: {'id': '482a06f562064620b943bbe85917e3b8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 04:03:47.727035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81657) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 30 04:03:47.743472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:03:47.744405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application yield resource Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise self.value Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application session.commit() Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:03:47.745812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:03:47.747020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:03:47.748489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:03:47.750613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [parameters: {'id': '482a06f562064620b943bbe85917e3b8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:47.753085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 04:03:47.757631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:47.759896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 237/478] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 30 04:03:47 2022] POST /identity/v3/roles => generated 144 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:47.760066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:47.863704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d143-dc5e-4f49-b750-4e2759e611e0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:47.899868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf80db-2cce-4754-a711-ceee9626d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:47.900499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf80db-2cce-4754-a711-ceee9626d331 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.900773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf80db-2cce-4754-a711-ceee9626d331 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.901039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf80db-2cce-4754-a711-ceee9626d331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.911948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf80db-2cce-4754-a711-ceee9626d331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-40cf80db-2cce-4754-a711-ceee9626d331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:47.917152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:47.918055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:47.919287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 242/479] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:03:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:47.924843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:47.956579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:48.073182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249f55-7e07-4410-8d00-8650e5e16926 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:48.118036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7341a3f-a0de-49ae-a182-d7c2e53fa33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:48.118641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7341a3f-a0de-49ae-a182-d7c2e53fa33c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:48.118910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7341a3f-a0de-49ae-a182-d7c2e53fa33c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:48.119174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7341a3f-a0de-49ae-a182-d7c2e53fa33c None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:48.119841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7341a3f-a0de-49ae-a182-d7c2e53fa33c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:48.120133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7341a3f-a0de-49ae-a182-d7c2e53fa33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:48.121483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7341a3f-a0de-49ae-a182-d7c2e53fa33c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:48.133732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 238/480] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:49.061082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66caf-babf-4059-b425-eaf1a9c908c7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.061620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66caf-babf-4059-b425-eaf1a9c908c7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.061620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66caf-babf-4059-b425-eaf1a9c908c7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.063142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 243/481] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:49.068101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759516-6fa7-46fa-85f3-03eb3479370c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.068518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759516-6fa7-46fa-85f3-03eb3479370c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.068716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759516-6fa7-46fa-85f3-03eb3479370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.091201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-85759516-6fa7-46fa-85f3-03eb3479370c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:49.092390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-85759516-6fa7-46fa-85f3-03eb3479370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:49.177691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 239/482] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:49.509661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66caf-babf-4059-b425-eaf1a9c908c7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:49.511781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be576b8-957e-4916-a196-9c37e0af3498 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.512060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be576b8-957e-4916-a196-9c37e0af3498 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.512329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be576b8-957e-4916-a196-9c37e0af3498 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.513956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 240/483] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:49.518434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11e3c-1f91-4fd0-9b9c-79616ea9b7cc None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.518770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11e3c-1f91-4fd0-9b9c-79616ea9b7cc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.519045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11e3c-1f91-4fd0-9b9c-79616ea9b7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.543828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:49.546495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f1b11e3c-1f91-4fd0-9b9c-79616ea9b7cc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:49.547714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1b11e3c-1f91-4fd0-9b9c-79616ea9b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:49.552257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:49.632464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66caf-babf-4059-b425-eaf1a9c908c7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:49.668241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1b0bd-4cfa-4d9d-a24e-18ccc10c9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:49.669211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b0bd-4cfa-4d9d-a24e-18ccc10c9603 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.669712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b0bd-4cfa-4d9d-a24e-18ccc10c9603 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.670170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1b0bd-4cfa-4d9d-a24e-18ccc10c9603 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.682582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1b0bd-4cfa-4d9d-a24e-18ccc10c9603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-55d1b0bd-4cfa-4d9d-a24e-18ccc10c9603 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:49.687687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:49.688851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:49.690394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:49.690999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 241/484] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:49.697151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 244/485] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:49.698794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11e3c-1f91-4fd0-9b9c-79616ea9b7cc None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:49.747308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03572f4-cc96-4b18-b975-3c5949a4bbb0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.747918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03572f4-cc96-4b18-b975-3c5949a4bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.748381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03572f4-cc96-4b18-b975-3c5949a4bbb0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.751306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 245/486] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:49.755706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c741b-9ca6-40a7-8a35-afbe1000c862 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.756213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c741b-9ca6-40a7-8a35-afbe1000c862 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.756725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c741b-9ca6-40a7-8a35-afbe1000c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.776955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-588c741b-9ca6-40a7-8a35-afbe1000c862 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:49.778464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-588c741b-9ca6-40a7-8a35-afbe1000c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:49.805553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11e3c-1f91-4fd0-9b9c-79616ea9b7cc None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:49.850373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:49.850998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.851570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.851676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:49.852281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:49.852577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:49.853962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:49.861829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 246/487] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:03:49.872806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 242/488] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:49.878563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c741b-9ca6-40a7-8a35-afbe1000c862 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:49.910899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.007939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c741b-9ca6-40a7-8a35-afbe1000c862 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.015925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.020146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.049547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07adfa-693e-4e83-80f5-8d4bcf6a94e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.050145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07adfa-693e-4e83-80f5-8d4bcf6a94e3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.050424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07adfa-693e-4e83-80f5-8d4bcf6a94e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.050693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07adfa-693e-4e83-80f5-8d4bcf6a94e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.061413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07adfa-693e-4e83-80f5-8d4bcf6a94e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.062912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07adfa-693e-4e83-80f5-8d4bcf6a94e3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ca07adfa-693e-4e83-80f5-8d4bcf6a94e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:50.079491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:50.080932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:50.081816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:50.081816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:50.081816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:50.085735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 247/489] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:50.087047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6110d-358d-42a7-bd33-9694fab60e82 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.087333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6110d-358d-42a7-bd33-9694fab60e82 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.087604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6110d-358d-42a7-bd33-9694fab60e82 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.089948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 248/490] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:50.090694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6110d-358d-42a7-bd33-9694fab60e82 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.127725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962514c-9f72-4c8c-bd62-27ab4c96a2fb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.164508 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461865-44a5-46f7-ad83-5073d176af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.165043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461865-44a5-46f7-ad83-5073d176af7c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.165261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461865-44a5-46f7-ad83-5073d176af7c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.165499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461865-44a5-46f7-ad83-5073d176af7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.169836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.175964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f461865-44a5-46f7-ad83-5073d176af7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4f461865-44a5-46f7-ad83-5073d176af7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:50.181291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:50.182181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:50.182971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 243/491] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:50.184069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87cd79-96e7-4292-bb91-f2e202591da9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.184162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87cd79-96e7-4292-bb91-f2e202591da9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.184358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87cd79-96e7-4292-bb91-f2e202591da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.202762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6110d-358d-42a7-bd33-9694fab60e82 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.203404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4a87cd79-96e7-4292-bb91-f2e202591da9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:50.204736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4a87cd79-96e7-4292-bb91-f2e202591da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:50.240803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.241503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.241870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.242205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.243473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:50.243473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.244493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.256920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 249/492] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:50.261970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.265006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.280513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 244/493] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:50.287033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87cd79-96e7-4292-bb91-f2e202591da9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.392176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad8c60-9c7c-4691-9675-dd237bbb2d55 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.395928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87cd79-96e7-4292-bb91-f2e202591da9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.426142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.433481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.434380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.434878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.435338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.436184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:50.436673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.438322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.438429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.439018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.439845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.440126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.449773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 250/494] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:50.450982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.452438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:50.459220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:50.460137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:50.460957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:50.465587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 245/495] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:50.466653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.538728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.582068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08803e96-afad-4699-b852-b70d9f745af3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.601580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99c2e0-4afc-42da-93c8-2720ffe18a11 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.619415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.620030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.620311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.620583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.628665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.630154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.637205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.637862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.638141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.638408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:50.643970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:50.644836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 251/496] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:50.646471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.653493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.655049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:50.672213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:50.673192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:50.674636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:50.674636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:50.674636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:50.674636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 246/497] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:50.674851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.708912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.760358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f0969-40fa-4011-abbe-1008249cb0f1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.789173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092550-541b-4320-91cb-ab1cd3a587b4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.792285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.795441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.796064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.796346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.796618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.797279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:50.797612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.799466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.807628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 252/498] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:50.808523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.831493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.832200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.832481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.832754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.844099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:50.849315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:50.850442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:50.851244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 247/499] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:50.851902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.912903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc41f9-41a0-4723-8d80-a95a5cf7bc02 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.926522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.947127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc4ffc-2b6c-4a6e-9fdc-2cc23d530f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.947716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc4ffc-2b6c-4a6e-9fdc-2cc23d530f09 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.947988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc4ffc-2b6c-4a6e-9fdc-2cc23d530f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.948255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc4ffc-2b6c-4a6e-9fdc-2cc23d530f09 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.948972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc4ffc-2b6c-4a6e-9fdc-2cc23d530f09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:50.949272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc4ffc-2b6c-4a6e-9fdc-2cc23d530f09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.949367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e09bf-2d95-4e86-9846-ffcd7f02ae74 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.950734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc4ffc-2b6c-4a6e-9fdc-2cc23d530f09 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.983889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.984488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.984765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.985036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.985707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:50.986010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.986097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 253/500] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:50.987820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c909d3-bd90-4491-ab9b-022aefaf4080 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.987920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.988101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c909d3-bd90-4491-ab9b-022aefaf4080 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.988369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c909d3-bd90-4491-ab9b-022aefaf4080 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.989754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 254/501] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:50.990257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c909d3-bd90-4491-ab9b-022aefaf4080 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.004535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 248/502] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:51.005728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.030188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.088792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c909d3-bd90-4491-ab9b-022aefaf4080 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.104073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74333135-67c7-4da3-b018-df6a4a9e275e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.123471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac590d9d-6a90-486c-98a8-44302bca4ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.124082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac590d9d-6a90-486c-98a8-44302bca4ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.124354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac590d9d-6a90-486c-98a8-44302bca4ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.124619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac590d9d-6a90-486c-98a8-44302bca4ef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.134421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac590d9d-6a90-486c-98a8-44302bca4ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.135860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac590d9d-6a90-486c-98a8-44302bca4ef9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.137410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.138038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.138319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.138591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.139256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:51.139558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.140908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.148771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 249/503] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:51.149572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ac590d9d-6a90-486c-98a8-44302bca4ef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:51.150646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:51.151506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:51.152391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:51.152391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.152391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:51.152391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 255/504] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:51.153441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e7b5b-fae8-49fe-a889-f30bdc91a627 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.153747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e7b5b-fae8-49fe-a889-f30bdc91a627 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.154017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e7b5b-fae8-49fe-a889-f30bdc91a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.172427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-433e7b5b-fae8-49fe-a889-f30bdc91a627 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:51.173568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-433e7b5b-fae8-49fe-a889-f30bdc91a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:51.190964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.238897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.239917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 256/505] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:51.240554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e7b5b-fae8-49fe-a889-f30bdc91a627 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.265715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728f9fc-9fa9-40fb-bf87-60df2a416daf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.306365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.306969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.307251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.307526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.348307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e7b5b-fae8-49fe-a889-f30bdc91a627 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.382645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.383260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.383534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.383802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.384222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.386080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.390734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.392151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:51.404060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:51.405238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:51.406168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 257/506] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:51.406758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.425639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.482491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.498761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 250/507] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:51.499536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.530535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef26241-ad22-4436-895c-c5950b696cdb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.563679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.564642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.564937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.565206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.575360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.579130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:51.594398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:51.595342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:51.596806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:51.596806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.596806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:51.596806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 258/508] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:51.597027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.604520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57125aba-e8e8-430c-9389-e383d3d72223 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.637494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.638183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.638460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.638730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.639370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:51.639668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.641030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.652631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 251/509] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:51.653406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.662580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.696740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736497-f383-4850-8e76-767c1d0a1c91 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.699896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.731205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.731792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.732072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.732343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.733057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:51.733386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.734834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.752047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 259/510] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:51.752457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13747-c5a2-4318-86c4-7106bfc16209 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.752838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.786517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.787136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.787489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.787762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.798031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.799533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:51.813359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:51.814944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:51.815828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:51.815828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.815828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:51.815828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 252/511] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:51.816445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.850789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee73305-10bd-40f4-b9fe-38937989d4e0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.873094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.884168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.884776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.885717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.885717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.895647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.897071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:51.911286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:51.912191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:51.913032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:51.913032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:51.913032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:51.913237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:51.913309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 260/512] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:51.913374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:51.917742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c119-eeaf-4bdc-851d-ea09f3e210ad None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:51.952238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:51.952768 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:51.953046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:51.953318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:51.953987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:51.954287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:51.956273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:51.968504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 253/513] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:51.969288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.018694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d945002-93d2-4622-b087-e75bfebb64bd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.053440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.054077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.054359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.054628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.062071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.063504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.065885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c878f-9fa3-4819-8424-247f9ed09aa4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:52.074469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:52.075392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 261/514] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:52.076309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.103115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.103711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.103986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.104253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.111293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.132049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.174661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.176115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.176800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457859bf-ed9c-40bf-9412-2e01b87a8a2c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.211276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.211803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.212082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.212356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.212989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:52.213290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.214968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.227039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 262/515] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:52.227826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.274285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 254/516] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:52.275116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.322118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.328792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb31c90-ff0d-463f-aefc-f76dc6adf98a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.337196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.363077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.363678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.363954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.364221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.364851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:52.365150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.366802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.378167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 263/517] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:52.378940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.379340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bfb2b-6605-4bd2-b7e7-9e9b2e535092 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.415309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.415926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.416201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.416469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.423268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.425284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:52.437905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:52.438973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:52.440695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 255/518] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:52.441375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.479976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b73eb-b146-42a3-92d2-748fe975530b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.513091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.513706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.513977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.514240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.514947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:52.515246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.516638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.532985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 264/519] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:52.534344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.539772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daa46a-fbc2-481e-8333-f3a2109191db None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.549852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.558860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.577085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.577827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.578133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.578438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.586399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.587859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:03:52.600705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:52.601575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:52.602440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 256/520] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:52.602908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.638029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f8a83-7bbd-47b5-8d0b-cfe4ab67261e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.671818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.672432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.672708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.672975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.682675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.684132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:52.698642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:52.699628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:52.700485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:52.700485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:52.700485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:52.700485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 265/521] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:52.700718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.704334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9391baa-3d25-43e6-a2fc-f7a319653e18 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.738207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.738729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.739004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.739291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.739905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.741379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.762233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 257/522] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:03:52 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:03:52.763310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.780232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.807948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:52.819861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fd31-101a-42e0-b7bb-dd5b5f695d38 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.859188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.859805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.860082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.860352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:52.861083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:52.861426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:52.862934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:52.883694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 266/523] 10.222.0.69 () {56 vars in 1139 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:52.884985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:52.895722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8a5e-121b-481c-9aa5-67d9b276e03e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:52.937327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:52.938577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:52.939065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:52.939995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.000665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14623-51da-44c6-814a-d529c5ed7e56 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.015015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.016529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.026374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.037877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.038486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.038766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.039040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.039735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:53.040041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.041463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.053615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.061655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 267/524] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:53.061655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.132041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 258/525] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:53.132967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.171547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783807ee-0ab6-4ad3-8423-b2a23ed81529 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.208550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.209145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.209419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.209717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.210350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:53.210643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.212000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.224366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 268/526] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:53.225180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.244795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b978839-f733-453f-a0e9-6cf374bec86f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.277567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.282920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.284058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.284327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.284589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.287255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.335869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b99ed-70c1-4049-b142-9495625f9e7f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.361561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.363004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.368634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.369307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.369618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.369892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.370612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=c8b82c351b9340ee88bbb4a9b490847f) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:53.370925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.372319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.378128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 269/527] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/role_assignments?user.id=c8b82c351b9340ee88bbb4a9b490847f&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:53.378896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.487411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 259/528] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:53.488722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.522392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a184d39-114f-46a0-b072-c430091af274 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.527370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.536465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.588299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.589236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.590649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.591063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.606400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.607892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.620780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27772-3ffe-41cf-9577-23571ad2d27d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:53.625067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:53.626169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:53.628081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:53.628081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:53.628081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:53.628081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 270/529] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:53.628081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.670792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.672280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.672779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.673652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.683177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.685670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:03:53.701794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:53.702668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:53.703520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:53.706268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 260/530] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:53.707257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.744389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e8c6-2eb3-4b6d-a8d6-683afc5de505 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.780428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.781450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.781808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.782197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.794049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.795618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:53.814103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:53.815652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:53.816697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:53.816697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:53.816697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:53.816697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 271/531] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:53.817299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.822254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.830916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f47e-09dc-4597-8c15-44c85e9e76ca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:53.837451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:53.872443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:53.873210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:53.873631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:53.874002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:53.874768 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:53.875170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:53.876625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:53.894403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 261/532] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:53.894403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:53.965318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268036b1-0e9f-469f-af02-1df45cdba428 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.009059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac289-81a6-4ea9-a0e6-4e58f6c1f3fa None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.009997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.010671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.011039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.011631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.013241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:54.013647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.015145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.031204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 272/533] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:54.032254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:54.062208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.063091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.063442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.063786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.064959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:54.065332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.067315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.083523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 262/534] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:54.085079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:54.110686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:54.119390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:54.151809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ef32d-6178-4910-a0a5-f77094d2436b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.189922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.191315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.191825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.192277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.200885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.202632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:03:54.215856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:54.216695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:54.217621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:54.218036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c7272-51a7-45ef-ae7d-478c9e831f9d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.225076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 273/535] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:54.226290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:54.257845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.258525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.258730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.258999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.260163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=94e017d6c128460eb8506dfb32697f74) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:54.260472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.262203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.270204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 263/536] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:54 2022] GET /identity/v3/role_assignments?user.id=94e017d6c128460eb8506dfb32697f74&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:54.271086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:54.346312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f227f0b-d6e3-4f0a-977c-9e99aff8429b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.421918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:54.425075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:54.437833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.439006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.439525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.440051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.453927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.456963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.464961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c31a5-ca02-4c5d-bd64-3cd29b168aef None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:03:54.483825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:54.484731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:54.485678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:54.488109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 274/537] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:54.495359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:54.546101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.547099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.548501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.549000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.549986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:54.553492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.555200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.625717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 264/538] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:54.636681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:54.745535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dd01-a9ab-4e71-a8a5-14764026c425 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.807330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a1443-7d6b-4152-9b3d-1a15971ff347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.807932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a1443-7d6b-4152-9b3d-1a15971ff347 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.808203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a1443-7d6b-4152-9b3d-1a15971ff347 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.808467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a1443-7d6b-4152-9b3d-1a15971ff347 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.809150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a1443-7d6b-4152-9b3d-1a15971ff347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:54.809451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a1443-7d6b-4152-9b3d-1a15971ff347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.810893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a1443-7d6b-4152-9b3d-1a15971ff347 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.829766 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b08d7-3417-45c1-9a7c-c63defbfd251 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:54.837865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 275/539] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:54.839126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fb3dc-0ed8-4b80-b602-87a4532ae910 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.841752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fb3dc-0ed8-4b80-b602-87a4532ae910 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.842022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fb3dc-0ed8-4b80-b602-87a4532ae910 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.844623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 276/540] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:54.845326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fb3dc-0ed8-4b80-b602-87a4532ae910 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:54.901617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e83ec-e96d-4699-aaba-a172071f9187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:54.901617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e83ec-e96d-4699-aaba-a172071f9187 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.901617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e83ec-e96d-4699-aaba-a172071f9187 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.901617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e83ec-e96d-4699-aaba-a172071f9187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.901992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e83ec-e96d-4699-aaba-a172071f9187 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=aa77ec9b56cd4027b22fbe0d7ff3ee1d) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:54.901992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e83ec-e96d-4699-aaba-a172071f9187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:54.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e83ec-e96d-4699-aaba-a172071f9187 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:54.916341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 265/541] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:54 2022] GET /identity/v3/role_assignments?user.id=aa77ec9b56cd4027b22fbe0d7ff3ee1d&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:54.921545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffa3fc-2dd7-4bab-af5e-102814a4231a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:54.921545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffa3fc-2dd7-4bab-af5e-102814a4231a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:54.921545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffa3fc-2dd7-4bab-af5e-102814a4231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:54.942784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:54.972997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:54.993539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5cffa3fc-2dd7-4bab-af5e-102814a4231a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:54.997538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5cffa3fc-2dd7-4bab-af5e-102814a4231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:55.117836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 266/542] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:55.156250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fb3dc-0ed8-4b80-b602-87a4532ae910 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:55.209188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74082250-2200-4000-9a9a-9412280f6c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:55.209862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082250-2200-4000-9a9a-9412280f6c47 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:55.210088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082250-2200-4000-9a9a-9412280f6c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:55.210321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082250-2200-4000-9a9a-9412280f6c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:55.211247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082250-2200-4000-9a9a-9412280f6c47 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=f520107f73aa48f791461922a3d6ec4b) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:55.211543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082250-2200-4000-9a9a-9412280f6c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:55.212958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082250-2200-4000-9a9a-9412280f6c47 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:55.221546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 277/543] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:54 2022] GET /identity/v3/role_assignments?user.id=f520107f73aa48f791461922a3d6ec4b&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 259 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:55.446625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffa3fc-2dd7-4bab-af5e-102814a4231a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:55.548162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f77f-a6fc-45e2-8bc1-a1308bc032c1 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:55.548450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f77f-a6fc-45e2-8bc1-a1308bc032c1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:55.548716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f77f-a6fc-45e2-8bc1-a1308bc032c1 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:55.550442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 278/544] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:55.555151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e71ee-0e8d-4e3e-90f3-e4bc19aa8c27 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:55.555435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e71ee-0e8d-4e3e-90f3-e4bc19aa8c27 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:55.555713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e71ee-0e8d-4e3e-90f3-e4bc19aa8c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:55.576418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffa3fc-2dd7-4bab-af5e-102814a4231a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:55.613724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5f6e71ee-0e8d-4e3e-90f3-e4bc19aa8c27 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:55.614920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5f6e71ee-0e8d-4e3e-90f3-e4bc19aa8c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:55.615202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:55.626867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:55.628266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:55.628710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:55.629911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:55.658624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:55.664910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:55.665882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:55.666674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 267/545] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:55.674811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:55.713534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 279/546] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:55.805994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301e59-a699-45a6-b9db-9dce1ca37551 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:55.849347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:55.850314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:55.850785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:55.851242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:55.852113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:55.852604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:55.854243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:55.864031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 268/547] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:55.869280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e71ee-0e8d-4e3e-90f3-e4bc19aa8c27 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:55.919216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:55.982737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e71ee-0e8d-4e3e-90f3-e4bc19aa8c27 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.024446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.025414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.025903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.026382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.037727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.039391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.048105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:56.065538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:56.066481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:56.067323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:56.067323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:56.067323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:56.067323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 280/548] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:56.073580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.118399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:56.172083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23acac-45da-4421-88ed-3908cc326b28 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.213898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.215740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.216225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.216915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.236660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:56.244152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:56.245015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:56.246402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:56.250110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 269/549] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:56.257395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.287133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:56.295729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67772580-5d48-4c0b-a877-c2e18c971f36 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.370871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8617943-1fe3-49e4-b924-01a4e873c9ec None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.383141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.384212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.384638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.385060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.386457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:56.386695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.388094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.390882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:56.417938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.419098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.421131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 281/550] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:56.421715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.422285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.423190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:56.423705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.425367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.426507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.440293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 270/551] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:56.446319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.552587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9a746-fbcc-4172-9a49-19ba0ff50703 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.598158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af198-7413-4a67-be00-9743507a6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.598798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af198-7413-4a67-be00-9743507a6544 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.599076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af198-7413-4a67-be00-9743507a6544 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.599351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af198-7413-4a67-be00-9743507a6544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.605316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bf061-869a-4322-8e9a-786b6ed316a9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.610960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7af198-7413-4a67-be00-9743507a6544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.613448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7af198-7413-4a67-be00-9743507a6544 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4a7af198-7413-4a67-be00-9743507a6544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:56.629046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:56.630014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:56.631002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:56.631002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:56.631002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:56.634841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 271/552] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:56.636059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670771-783c-4ccc-8eb9-c8865b2376cf None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.636346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670771-783c-4ccc-8eb9-c8865b2376cf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.636619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670771-783c-4ccc-8eb9-c8865b2376cf None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.638138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 272/553] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:56.639042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42670771-783c-4ccc-8eb9-c8865b2376cf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.647052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1f09a-a3b8-471d-87b3-5482ddef7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.648007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f09a-a3b8-471d-87b3-5482ddef7d69 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.648485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f09a-a3b8-471d-87b3-5482ddef7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.648985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f09a-a3b8-471d-87b3-5482ddef7d69 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.657708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1f09a-a3b8-471d-87b3-5482ddef7d69 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.659642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1f09a-a3b8-471d-87b3-5482ddef7d69 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.671770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-25b1f09a-a3b8-471d-87b3-5482ddef7d69 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:56.675467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:56.676389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:03:56.677316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:56.680385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 282/554] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:56.681976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b64ae-0d79-4cfd-9321-fd7fb5078630 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.682459 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b64ae-0d79-4cfd-9321-fd7fb5078630 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.683005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b64ae-0d79-4cfd-9321-fd7fb5078630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.702716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c97b64ae-0d79-4cfd-9321-fd7fb5078630 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:56.704304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c97b64ae-0d79-4cfd-9321-fd7fb5078630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:56.727812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:56.757020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42670771-783c-4ccc-8eb9-c8865b2376cf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.777897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 283/555] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:56.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b64ae-0d79-4cfd-9321-fd7fb5078630 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.793225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.793879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.794156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.794428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.795189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:56.795473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.796955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.815397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 273/556] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:03:56.816543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.886559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b64ae-0d79-4cfd-9321-fd7fb5078630 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.921909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.922878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.923371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.923840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.925402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:56.925961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.927697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.956266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 284/557] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:56.963881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:56.968707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:56.976824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:57.001449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd14f1b-f10d-4e0b-ad1f-0bd27c8f5c29 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.069173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.070193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.070680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.071140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.084922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13526d-e6e9-4ff6-86f5-f9050e35580f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.087137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.089071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:57.110755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:57.112773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:03:57.113736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:57.120632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 274/558] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:03:57.122142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.122511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.123225 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.123511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.123765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.202600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.204029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.213983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:57.315333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a274-1f17-433e-abf6-20a62a7b10fd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.329709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 285/559] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:03:57.331135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.358645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.359565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.360108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.360432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.361317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:57.361982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.363802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.402105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 275/560] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:57.403314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.412268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:57.442170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50b660-57c2-4106-b267-c74e8cae4058 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.450038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:57.481554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41c3a3-0fc3-4c59-b1e9-238a95a8d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.482632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c3a3-0fc3-4c59-b1e9-238a95a8d854 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.482914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c3a3-0fc3-4c59-b1e9-238a95a8d854 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.483186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c3a3-0fc3-4c59-b1e9-238a95a8d854 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.495026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41c3a3-0fc3-4c59-b1e9-238a95a8d854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3b41c3a3-0fc3-4c59-b1e9-238a95a8d854 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:57.499902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:57.500828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:57.501729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 286/561] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:57.503005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287e630-4aee-4129-a6ad-d8f4c8f65bcb None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.503005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287e630-4aee-4129-a6ad-d8f4c8f65bcb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.503925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287e630-4aee-4129-a6ad-d8f4c8f65bcb None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.509327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 287/562] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:57.509327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287e630-4aee-4129-a6ad-d8f4c8f65bcb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.514508 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98a50e-780a-4310-852c-a42a9555d89d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.550831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.551459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.551739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.552007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.562177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.563623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:57.578784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:57.579967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:57.581222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:57.581222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:57.581222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:57.581222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 276/563] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:57.581222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.613217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287e630-4aee-4129-a6ad-d8f4c8f65bcb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.637799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:57.647437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714d5a-1f14-463c-a878-848e8bc54e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.648054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714d5a-1f14-463c-a878-848e8bc54e4c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.648329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714d5a-1f14-463c-a878-848e8bc54e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.648597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714d5a-1f14-463c-a878-848e8bc54e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.659728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714d5a-1f14-463c-a878-848e8bc54e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.661133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714d5a-1f14-463c-a878-848e8bc54e4c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b1714d5a-1f14-463c-a878-848e8bc54e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:57.675422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:57.676562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:57.677480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:57.677480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:57.677480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:57.677480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 288/564] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:57.677778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced28d0-b73a-4a50-8ce8-9ae0eb240b59 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.677943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced28d0-b73a-4a50-8ce8-9ae0eb240b59 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.678204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced28d0-b73a-4a50-8ce8-9ae0eb240b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.684889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357784a-a544-428a-a553-0a4da8bb1f9b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.695100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5ced28d0-b73a-4a50-8ce8-9ae0eb240b59 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:57.696287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5ced28d0-b73a-4a50-8ce8-9ae0eb240b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:57.709293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:57.718701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e902b-6198-43fa-96ac-678239c68f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.719280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e902b-6198-43fa-96ac-678239c68f48 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.719555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e902b-6198-43fa-96ac-678239c68f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.719824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e902b-6198-43fa-96ac-678239c68f48 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.720477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e902b-6198-43fa-96ac-678239c68f48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:57.720776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e902b-6198-43fa-96ac-678239c68f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.722746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e902b-6198-43fa-96ac-678239c68f48 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.730655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 277/565] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:57.731599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f4f4-1dd3-456f-b4f5-9dd3bd934fb6 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.731877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f4f4-1dd3-456f-b4f5-9dd3bd934fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.732147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f4f4-1dd3-456f-b4f5-9dd3bd934fb6 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.733499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 278/566] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:03:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:57.734078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6f4f4-1dd3-456f-b4f5-9dd3bd934fb6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.766951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 289/567] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:57.768385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced28d0-b73a-4a50-8ce8-9ae0eb240b59 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.836177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6f4f4-1dd3-456f-b4f5-9dd3bd934fb6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.857005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:57.873267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.873924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.874200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.874469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.875101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:57.875397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.876765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.879162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced28d0-b73a-4a50-8ce8-9ae0eb240b59 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:57.889037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 279/568] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:57.890783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:57.916462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5ac00-19cd-43c2-9bef-9eb2016fc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:57.917083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5ac00-19cd-43c2-9bef-9eb2016fc09f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.917358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5ac00-19cd-43c2-9bef-9eb2016fc09f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.917731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5ac00-19cd-43c2-9bef-9eb2016fc09f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.918312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5ac00-19cd-43c2-9bef-9eb2016fc09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:57.918608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5ac00-19cd-43c2-9bef-9eb2016fc09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:57.920159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5ac00-19cd-43c2-9bef-9eb2016fc09f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:57.936871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 290/569] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:57.938141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c9c79-c320-481f-bc2f-465ef3400683 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:57.938425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c9c79-c320-481f-bc2f-465ef3400683 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:57.938701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c9c79-c320-481f-bc2f-465ef3400683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:57.957255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a15c9c79-c320-481f-bc2f-465ef3400683 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:57.958738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a15c9c79-c320-481f-bc2f-465ef3400683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:57.960893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.000000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231aa0-cc27-419e-beee-b59d5bb23d3c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.030702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 291/570] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:03:58.031704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c9c79-c320-481f-bc2f-465ef3400683 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.044635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.045262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.045643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.045913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.058278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.059690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:58.075191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:58.076151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:58.082588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:58.082588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:58.082588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:58.082588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 280/571] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:58.082588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.115510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.141818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c9c79-c320-481f-bc2f-465ef3400683 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.175599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.176541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.177049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.177963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.184872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.186307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.188084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.190956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9308-b9e9-43e6-9147-f01971cebad0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:03:58.198697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:58.199839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:58.200811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:58.205938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 292/572] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:58.207027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.229217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.229880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.230671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.230947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.239539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.241020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:03:58.252141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:58.253593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 281/573] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:58.254500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.324228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030c5de-35e1-433a-883b-aea7a09b9cc0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.347077 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.355945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd239f-3232-45c3-9828-9cdd39dbf577 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.357051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.357702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.357980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.358250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.368543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:58.373654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:58.374754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 293/574] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:58.375611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.391177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.391771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.392046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.392309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.392964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:58.394265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.395968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.409952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 282/575] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:58.410663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.444125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.484827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd53c5-e775-46a8-81e0-6bf13cb99055 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.509568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80faf0-8fa8-4fef-9e1b-882f0f170732 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.518404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.518991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.519263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.519528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.520196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:58.520493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.521929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.533929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 294/576] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:58.534840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.543552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.544177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.544450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.544717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.545409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:58.545745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.547162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.558924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 283/577] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:58.559693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.573835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.643680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372152cd-bd31-46b9-8c81-3a92d11c9cb3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.661373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.662936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df675e-2c00-4e1f-b3b5-3f65bb621dfb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.679138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.679753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.680024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.680291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.689980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:03:58.694688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:58.695606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:58.696439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 295/578] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:58.697151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.698565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.699173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.699451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.699720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.700615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:58.700890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.703152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.711203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 284/579] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:58.711994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.785536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.796001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29d80d-20c7-48e0-ba22-adc4c922f314 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.810935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7dab-fca1-4470-b109-1e0eb92e5fc7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.828716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.829321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.829620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.829884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.836642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.838097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.843774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:58.844365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:58.844642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:58.844911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:58.845691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=16ba94b3c081488a851579dc5883427b) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:58.846522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:58.847919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:58.849922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:58.856133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 296/580] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:58.857237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.869605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 285/581] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/role_assignments?user.id=16ba94b3c081488a851579dc5883427b&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:58.869605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:58.898571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:58.976019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290440b3-2f53-4978-8dfd-5f1c63c30353 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:58.985959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb440df-c553-43b2-98b9-a104f30f17db None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.017087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.017880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.018155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.018595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.019561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:59.020123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.021482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.024199 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.024859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.025141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.025414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/c8b82c351b9340ee88bbb4a9b490847f/roles/d58aba80ce4142dfade37664a1f81d8f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.026805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.032280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 286/582] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:03:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:59.033014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.047079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=c8b82c351b9340ee88bbb4a9b490847f, role_id=d58aba80ce4142dfade37664a1f81d8f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.048532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.062574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 297/583] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:03:58 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/c8b82c351b9340ee88bbb4a9b490847f/roles/d58aba80ce4142dfade37664a1f81d8f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:03:59.063301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.165351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aa98b-6050-42f3-9231-f0092020cdd0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.195416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.210842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cfe64-b20a-49a5-a6d4-cf1609235cf7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.216904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.217561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.217841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.218109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.231206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.232657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:59.248259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:59.249484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:59.250446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:59.250446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:59.250446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:59.253939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 287/584] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:59.254783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.255745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.256562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.257014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.257473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.258502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:59.259004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.260637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.281560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 298/585] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:59.282685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.326030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.390148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772921e-6f4f-4a6f-9112-5d05d7152829 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.392522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120be9f-6d1d-417c-8e00-d10662b90dd4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.430728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.431555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.431994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.432405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.432706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.433355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:59.433533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.433948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.434122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.434388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.435770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.448307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.449368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 299/586] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:59.450448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.454272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.462757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:59.482497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:59.483513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:59.484399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:59.484399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:59.484399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:59.484399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 288/587] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:59.489818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.565774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6ab89-8df0-45b0-96a6-310d97e1897e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.606466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.607500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.608048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.608491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.620862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.622621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.633398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4847-eaa4-4db9-b31a-c89b158bb53b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.635822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:03:59.639063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:59.639976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:03:59.640880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:03:59.640880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:03:59.640880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:03:59.643438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 300/588] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:59.644932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.677481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.678479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.678813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.679090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.690635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.692014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:03:59.708384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:03:59.709327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:03:59.710341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 289/589] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:03:59.710911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.716517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.769632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1bb0a-9df6-457e-9a08-3e0d7ff71903 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.817845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.818450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.818726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.819143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.820061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:59.820365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.822004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.831686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ef31-a479-4d50-a4fc-79432eccc0ac None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.837556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 301/590] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:59.837556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.873657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.874463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.874836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.875201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.875935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:59.876368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.878503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:59.892438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 290/591] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:03:59.893560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:59.920937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.939517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bbd4-078d-4301-9a10-1112ba66ea27 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:59.959621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:59.979952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:59.980554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:59.980829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:59.981309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:59.982089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:03:59.982408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:59.983806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.002993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 302/592] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:00.003884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.011960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d922ae-8a1b-44e5-902a-e1edf3246362 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.048635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.050252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.050729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.051215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.058925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.060563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:00.072697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:00.073664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:04:00.074600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:00.076716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 291/593] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:03:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:00.077715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.106999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018021d-1aff-48e6-9181-cc8272e2cdf2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.142981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.143610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.143879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.144148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.151209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.152707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:00.165616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:00.166542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:00.167411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 303/594] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:00.167914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.172258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:00.190964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab7bcc-02d4-4c9d-afa1-d28d8350a3ae None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.204446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:00.227945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.229102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.229620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.230173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.244158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.246422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:00.263263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:00.264282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:00.265160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:00.265160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:00.265160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:00.267245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 292/595] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:00.268249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.275738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f71d9-f877-46ba-a859-8484fd2d97b7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.311392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.311989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.312265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.312531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.313254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:00.313578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.315545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.333835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 304/596] 10.222.0.69 () {56 vars in 1139 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:00.334850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.383637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ca14e-f0a7-44ce-88a5-4ee0289338a8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.425961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.427026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.427646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.428110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.429066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:00.429588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.431483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.433526 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:00.435508 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:00.442734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9091c-a6fa-4f6b-baf4-3fec62fddaf8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.448359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 293/597] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:00.449360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.481411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.482483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.483343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.483903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.484799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:00.485259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.488517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.505375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 305/598] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:00.506822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.571952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e31e8-e1c2-45b2-a3b6-faf59b12aaee None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.622683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.624107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.624831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.625315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.635329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd32da-75cd-4d73-9963-3d183fc3a6ab None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.640731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.643362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:00.664503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:00.665533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:00.666434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:00.666434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:00.666434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:00.667161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 294/599] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:00.667950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.676912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.677605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.677887 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.678161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/94e017d6c128460eb8506dfb32697f74/roles/d58aba80ce4142dfade37664a1f81d8f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.695395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=94e017d6c128460eb8506dfb32697f74, role_id=d58aba80ce4142dfade37664a1f81d8f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.696884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.713992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 306/600] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:00 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/94e017d6c128460eb8506dfb32697f74/roles/d58aba80ce4142dfade37664a1f81d8f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:04:00.716071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.720049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:00.736383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:00.831460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da933cdf-2da9-44e9-95b9-9c2b94c12cdf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.851029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af30c2d-a116-4c61-9f4e-477d1b1cb2e8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:00.871635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e803c0-dad8-4568-a4ca-759f91884498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.872317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e803c0-dad8-4568-a4ca-759f91884498 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.872599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e803c0-dad8-4568-a4ca-759f91884498 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.872875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e803c0-dad8-4568-a4ca-759f91884498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.881063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e803c0-dad8-4568-a4ca-759f91884498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.882707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e803c0-dad8-4568-a4ca-759f91884498 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.896008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370260-51c4-4384-b6f6-d51d1c406c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:00.896616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370260-51c4-4384-b6f6-d51d1c406c6f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-63e803c0-dad8-4568-a4ca-759f91884498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:00.896816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:00.897711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:00.898601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:00.899041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370260-51c4-4384-b6f6-d51d1c406c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.899041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370260-51c4-4384-b6f6-d51d1c406c6f None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.899041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370260-51c4-4384-b6f6-d51d1c406c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:00.899041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370260-51c4-4384-b6f6-d51d1c406c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:00.899283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 295/601] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:00.899836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370260-51c4-4384-b6f6-d51d1c406c6f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:00.899998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214db5-d0f4-4034-aba1-fb8a80de483e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.899998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214db5-d0f4-4034-aba1-fb8a80de483e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.900284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e214db5-d0f4-4034-aba1-fb8a80de483e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.905831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 296/602] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:00.906775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e214db5-d0f4-4034-aba1-fb8a80de483e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:00.914562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 307/603] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:00.915132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff1e5-a8cf-49bd-a096-de9c4b10f134 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:00.915413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff1e5-a8cf-49bd-a096-de9c4b10f134 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:00.915686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff1e5-a8cf-49bd-a096-de9c4b10f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:00.937153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7c7ff1e5-a8cf-49bd-a096-de9c4b10f134 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:00.938402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7c7ff1e5-a8cf-49bd-a096-de9c4b10f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:01.013630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:01.023835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 308/604] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:01.024553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ff1e5-a8cf-49bd-a096-de9c4b10f134 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:01.065425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e214db5-d0f4-4034-aba1-fb8a80de483e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:01.081760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:01.149702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d21a-d1fe-49a2-98a6-f18db2082b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:01.150311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d21a-d1fe-49a2-98a6-f18db2082b74 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.151490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d21a-d1fe-49a2-98a6-f18db2082b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.151758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d21a-d1fe-49a2-98a6-f18db2082b74 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.152454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d21a-d1fe-49a2-98a6-f18db2082b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:01.152751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d21a-d1fe-49a2-98a6-f18db2082b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:01.154288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d21a-d1fe-49a2-98a6-f18db2082b74 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:01.167779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 297/605] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:01.169086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584aa73-608d-4ba2-8e29-3552b753522b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.169369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584aa73-608d-4ba2-8e29-3552b753522b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.169662 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584aa73-608d-4ba2-8e29-3552b753522b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.171113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 298/606] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:01.172897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584aa73-608d-4ba2-8e29-3552b753522b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:01.175982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ff1e5-a8cf-49bd-a096-de9c4b10f134 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:01.222866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fae59-a78c-4054-9739-0bffae925691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:01.223568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fae59-a78c-4054-9739-0bffae925691 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.224364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fae59-a78c-4054-9739-0bffae925691 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.224671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fae59-a78c-4054-9739-0bffae925691 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.234228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fae59-a78c-4054-9739-0bffae925691 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:01.236255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fae59-a78c-4054-9739-0bffae925691 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ba8fae59-a78c-4054-9739-0bffae925691 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:01.251780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:01.252978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:01.254008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 309/607] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:01.254520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767d6b0-d7e7-4d21-b908-d867c84517b3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.257552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767d6b0-d7e7-4d21-b908-d867c84517b3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.257552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767d6b0-d7e7-4d21-b908-d867c84517b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.280007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9767d6b0-d7e7-4d21-b908-d867c84517b3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:01.281265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9767d6b0-d7e7-4d21-b908-d867c84517b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:01.296886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584aa73-608d-4ba2-8e29-3552b753522b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:01.338368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:01.343112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:01.343787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.344069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.344372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/aa77ec9b56cd4027b22fbe0d7ff3ee1d/roles/d58aba80ce4142dfade37664a1f81d8f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.354858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 310/608] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:01.356113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767d6b0-d7e7-4d21-b908-d867c84517b3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:01.361072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=aa77ec9b56cd4027b22fbe0d7ff3ee1d, role_id=d58aba80ce4142dfade37664a1f81d8f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:01.363084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:01.389018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 299/609] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:01 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/aa77ec9b56cd4027b22fbe0d7ff3ee1d/roles/d58aba80ce4142dfade37664a1f81d8f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:04:01.390364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:01.435590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:01.561181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767d6b0-d7e7-4d21-b908-d867c84517b3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:01.591902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43168c-6558-40c2-8185-66095578a482 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:01.620619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:01.621881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.622355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.623056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.624356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:01.625125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:01.628081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:01.638511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:01.639150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.639426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.641225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.655437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 311/610] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:01.665950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:01.670478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:01.670908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:01.671809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:01.673311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 300/611] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:01.678267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:01.745890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:01.775977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c4968-6bad-473e-aa31-78e14b0428c9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:01.780835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:01.817727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7bf4-44cf-4267-8951-0c139f307509 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:01.822598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:01.823706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.824184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.824846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/f520107f73aa48f791461922a3d6ec4b/roles/d58aba80ce4142dfade37664a1f81d8f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.846314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=f520107f73aa48f791461922a3d6ec4b, role_id=d58aba80ce4142dfade37664a1f81d8f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:01.847357 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:01.848060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.848433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.848657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:01.848882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.849691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:01.850088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:01.851521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:01.862726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 301/612] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:01.863572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:01.866873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 312/613] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:01 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/f520107f73aa48f791461922a3d6ec4b/roles/d58aba80ce4142dfade37664a1f81d8f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:04:01.868168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.043466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:02.053400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b77f86-2ffb-4819-b1fa-3d28abe58b03 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.063812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fd8bf-24d5-47e0-b4a6-ee4154017c68 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.095742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.096691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.097908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.098505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.109462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:02.115034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:02.121208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:02.124020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:02.124862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:02.128042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 302/614] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:02.132356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.132356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.132356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.132356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.133755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.143424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:02.144988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:02.163115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:02.164108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:02.165021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:02.165021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:02.165021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:02.165021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 313/615] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:02.170378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.311328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32910f3b-4c8e-4cd3-9482-1f525dcdacff None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.339814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7331dd-0fd6-4acb-8e2b-6ee9525b52d9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.350675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.351256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.351530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.351799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.352632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:02.352929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:02.354517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:02.367665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 314/616] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:02.373092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.387053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:02.431808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.432428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.432735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.433003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.433701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:02.434002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:02.435368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:02.457447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 303/617] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:02.463134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.493409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fddc5c-5577-4601-914b-dca994d15146 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.564318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:02.576909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.577588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.577849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.578121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.602422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:02.603812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:02.610601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf616-317d-431f-ba27-49a1bf97dcba None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:02.632671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:02.633795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:02.634744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 315/618] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:02.642444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.648461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.649172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.649449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.649792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.663280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:02.665336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:02.682099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:02.684557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:02.687496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:02.687496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:02.687496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:02.687496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 304/619] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:02.694122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.811818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86402937-3083-460a-82e1-a1f725863a0e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.828155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:02.837788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:02.874427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.875447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.875919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.876408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.878940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:02.879444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:02.882693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:02.906454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 305/620] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:02.910285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:02.919171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b880d-a04f-4aff-937f-8155097021eb None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:02.973522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bc9cb-4a55-4cdc-bb21-8237168a503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:02.974137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bc9cb-4a55-4cdc-bb21-8237168a503a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.974413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bc9cb-4a55-4cdc-bb21-8237168a503a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.974681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bc9cb-4a55-4cdc-bb21-8237168a503a None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:02.975405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bc9cb-4a55-4cdc-bb21-8237168a503a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:02.975706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bc9cb-4a55-4cdc-bb21-8237168a503a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:02.977132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bc9cb-4a55-4cdc-bb21-8237168a503a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:02.996042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 316/621] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 30 04:04:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:02.997418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324cab4-c956-4db2-94d3-9214b4e04527 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:02.997736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324cab4-c956-4db2-94d3-9214b4e04527 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:02.998009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324cab4-c956-4db2-94d3-9214b4e04527 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.004071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 317/622] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:03.004986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324cab4-c956-4db2-94d3-9214b4e04527 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:03.054170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019409a-b1ff-4f81-871f-6ba51ec1c260 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:03.103731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e501-81ea-4cba-8799-2d11164ca0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:03.103731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e501-81ea-4cba-8799-2d11164ca0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.103731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e501-81ea-4cba-8799-2d11164ca0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.103731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e501-81ea-4cba-8799-2d11164ca0b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.109844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6e501-81ea-4cba-8799-2d11164ca0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:03.111532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6e501-81ea-4cba-8799-2d11164ca0b4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:03.120321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324cab4-c956-4db2-94d3-9214b4e04527 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7ba6e501-81ea-4cba-8799-2d11164ca0b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:03.124407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:03.125389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:03.127023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 306/623] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:04:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:03.127669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2859-9c03-4a6f-84c5-34597ccce533 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.127669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2859-9c03-4a6f-84c5-34597ccce533 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.127669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2859-9c03-4a6f-84c5-34597ccce533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.146180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:03.149827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-77dd2859-9c03-4a6f-84c5-34597ccce533 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:03.152060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-77dd2859-9c03-4a6f-84c5-34597ccce533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:03.159740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:03.160497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.160833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.161164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.172842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:03.175011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:03.188264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:03.194702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:03.195868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:03.197002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:03.197002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:03.197002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:03.197721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 318/624] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:03.198669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:03.240487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 307/625] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:03.241728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2859-9c03-4a6f-84c5-34597ccce533 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:03.362547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20928ce5-2047-4a43-9334-da15d9fabb8c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:03.416822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2859-9c03-4a6f-84c5-34597ccce533 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:03.427874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:03.428743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.429248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.429744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.430667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:03.431165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:03.432781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:03.462937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 319/626] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:03.467056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:03.481684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:03.482587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.483062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.485152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.486034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:03.486536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:03.488602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:03.510012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 308/627] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:03.522494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:03.527522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:03.567827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:03.647813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475d18-220f-4388-bf5c-1c21a4c0a790 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:03.678176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28833d-d87e-4c7d-97e5-8c93e3874619 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:03.684455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311287c-6047-4049-8196-6196664a82d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:03.685045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311287c-6047-4049-8196-6196664a82d4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.685325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311287c-6047-4049-8196-6196664a82d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.685626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311287c-6047-4049-8196-6196664a82d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.716752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:03.717383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.717696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.717969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.725642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:03.727087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:03.739356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:03.740273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 309/628] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:03.741194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:03.765005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311287c-6047-4049-8196-6196664a82d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:03.766881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311287c-6047-4049-8196-6196664a82d4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:03.803479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:03.829110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:03.846073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518a33-fec5-457a-83eb-15061b18c0a4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:03.876820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 320/629] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:03.878623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f383d-214a-4d37-a763-a12c46237cb6 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.878898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f383d-214a-4d37-a763-a12c46237cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.879160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f383d-214a-4d37-a763-a12c46237cb6 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.880518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 321/630] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:03.884649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:03.885089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f383d-214a-4d37-a763-a12c46237cb6 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:03.885284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:03.885600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:03.885874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:03.896985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:03.902307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:03.903216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:03.904055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 310/631] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:03.904769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.000864 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f383d-214a-4d37-a763-a12c46237cb6 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.012938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4670b2-1ed8-4f84-ae31-e6d3c58f1527 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.036144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a3346-cd0f-4854-8b31-3358b1d4e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.036738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3346-cd0f-4854-8b31-3358b1d4e541 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.037014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3346-cd0f-4854-8b31-3358b1d4e541 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.037283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a3346-cd0f-4854-8b31-3358b1d4e541 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.038157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3346-cd0f-4854-8b31-3358b1d4e541 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:04.038465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3346-cd0f-4854-8b31-3358b1d4e541 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.040012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a3346-cd0f-4854-8b31-3358b1d4e541 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.042152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.047016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.048117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.048419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.048693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.054531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 322/632] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:04.055907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792971-c1c3-48ff-9a0b-d0a50df5db94 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.056354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792971-c1c3-48ff-9a0b-d0a50df5db94 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.056905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e792971-c1c3-48ff-9a0b-d0a50df5db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.063126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.064579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.067175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.076944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0e792971-c1c3-48ff-9a0b-d0a50df5db94 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:04.078387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0e792971-c1c3-48ff-9a0b-d0a50df5db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:04.079881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:04.081026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:04.081961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:04.081961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:04.081961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:04.081961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 311/633] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:04.082189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.151524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 323/634] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:04.152398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e792971-c1c3-48ff-9a0b-d0a50df5db94 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.195435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b13c3-750b-4fef-bb51-d2fdc383b1b6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.229390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.230009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.230284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.230548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.231197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:04.231489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.232849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.240876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 312/635] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:04.241681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.264500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e792971-c1c3-48ff-9a0b-d0a50df5db94 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.290478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.302489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.302853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915fa5a-dcd5-4375-ae2a-8cd21bce1d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.303559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915fa5a-dcd5-4375-ae2a-8cd21bce1d91 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.303809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915fa5a-dcd5-4375-ae2a-8cd21bce1d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.304200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915fa5a-dcd5-4375-ae2a-8cd21bce1d91 None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/16ba94b3c081488a851579dc5883427b/roles/d58aba80ce4142dfade37664a1f81d8f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.320094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915fa5a-dcd5-4375-ae2a-8cd21bce1d91 None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=16ba94b3c081488a851579dc5883427b, role_id=d58aba80ce4142dfade37664a1f81d8f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.321539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915fa5a-dcd5-4375-ae2a-8cd21bce1d91 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.345626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 324/636] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:04 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/16ba94b3c081488a851579dc5883427b/roles/d58aba80ce4142dfade37664a1f81d8f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:04:04.349196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeabc4-8a87-4e9b-855d-7f890f05a4f5 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.349821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeabc4-8a87-4e9b-855d-7f890f05a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.350339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeabc4-8a87-4e9b-855d-7f890f05a4f5 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.350845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d979-4021-4b37-a45f-760d3b98b762 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.356956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 325/637] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:04.356956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeabc4-8a87-4e9b-855d-7f890f05a4f5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.397948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db6bb2-87b0-496e-9631-7a344fc79f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.398385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6bb2-87b0-496e-9631-7a344fc79f65 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.398660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6bb2-87b0-496e-9631-7a344fc79f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.398927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6bb2-87b0-496e-9631-7a344fc79f65 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.399626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6bb2-87b0-496e-9631-7a344fc79f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:04.399929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6bb2-87b0-496e-9631-7a344fc79f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.401364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6bb2-87b0-496e-9631-7a344fc79f65 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.416518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 313/638] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:04.417403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362987-8d18-49c3-8b78-2bbfb990eb7c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.417772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362987-8d18-49c3-8b78-2bbfb990eb7c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.418050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362987-8d18-49c3-8b78-2bbfb990eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.436828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e5362987-8d18-49c3-8b78-2bbfb990eb7c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:04.438093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e5362987-8d18-49c3-8b78-2bbfb990eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:04.500311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeabc4-8a87-4e9b-855d-7f890f05a4f5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.525683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 314/639] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:04.526510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362987-8d18-49c3-8b78-2bbfb990eb7c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.539213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.539830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.540102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.540410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.551341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.552762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:04.568456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:04.569434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:04.570779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:04.570779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:04.570779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:04.570779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 326/640] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:04.570779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.589840 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.601009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.662883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362987-8d18-49c3-8b78-2bbfb990eb7c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.687884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12522da2-5065-4c2c-837c-96e3ee4c59c4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.716959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.717632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.717860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.718127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.728775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32968177-881e-482d-9f27-819a0537f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.729105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:04.729462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32968177-881e-482d-9f27-819a0537f618 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.729759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32968177-881e-482d-9f27-819a0537f618 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.730033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32968177-881e-482d-9f27-819a0537f618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:04.733854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:04.735985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:04.738587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:04.745762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32968177-881e-482d-9f27-819a0537f618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.745762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32968177-881e-482d-9f27-819a0537f618 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.745940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 315/641] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:04.745940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-32968177-881e-482d-9f27-819a0537f618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:04.753576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:04.754942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 327/642] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:04.756336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32968177-881e-482d-9f27-819a0537f618 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.854621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce09e5-511b-49ef-85b9-bdb3251424e0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.856230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.865089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:04.874785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32968177-881e-482d-9f27-819a0537f618 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:04.890108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.890738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.891008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.891277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.891907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:04.892204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.894107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.910223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 316/643] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:04.910223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:04.914929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:04.915527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:04.915801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:04.916124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:04.916776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:04.917208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:04.918585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:04.927094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 328/644] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:04.932193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.009115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54538fa-77c8-41ab-b1b9-99585f1df03e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.036676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba6c02-7635-4b4f-a0e4-5808349af2bc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.044711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.045313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.045602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.045868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.046546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:05.046844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.048253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.059917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 317/645] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:05.060699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.074868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.075481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.075754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.076018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.087637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:05.090674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:05.092994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:05.094409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 329/646] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:05.095871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.106493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.172577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d242e7e-1c34-45c4-aa90-8cbface11171 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.204462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613b409-1c73-498e-b0e0-bae2820cb2e9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.208516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.209201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.209483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.209781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.217036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.218664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:05.231127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:05.232082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 318/647] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:05.233034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.247634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.248326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.248667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.249004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.259570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.260983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:05.275322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:05.276347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:05.277251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:05.277251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:05.277251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:05.277251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 330/648] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:05.277251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.332228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.343449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.345783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d635f-dede-41f8-8be4-6e4f15e20d31 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.382165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.382683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.382956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.383220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.383934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=c8b82c351b9340ee88bbb4a9b490847f) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:05.384233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.385657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.386749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eaf8f-abf5-4da2-8957-90a332cb420b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.401562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 319/649] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/role_assignments?user.id=c8b82c351b9340ee88bbb4a9b490847f&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:05.401562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.437916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.438889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.439725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.441023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.441959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:05.442351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.444102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.457685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 331/650] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:05.458657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.539781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a425a7-0038-42ad-9b10-f851c7131cca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.585087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.586523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.587182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.587780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.588730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:05.589154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b32b46-4a64-4e74-94fc-142994caef3b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.589468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.592207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.613947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 320/651] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:05.614680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.626650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.627318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.639401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.639401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.639647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.639721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.640339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:05.640632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.642012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.660185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 332/652] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:05.660360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.751205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d0f43-45ea-43d3-be17-dd1580db3e40 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.787322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.788317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.788824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.789303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.791137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e2153-6dff-4f2a-bb14-39f66c98d354 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.801094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.802927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:05.819613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:05.820618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:05.821540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:05.821540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:05.821540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:05.823237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 321/653] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:05.824324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:05.832032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.832640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.832914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.833178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.898005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.900556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:05.925466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.927395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.934536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8128461-229e-40a9-afb2-b3f89908c7fd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:05.972409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:05.973450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:05.973997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:05.974469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:05.982974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:05.984756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:05.998669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:05.999643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 04:04:06.000601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:06.008233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 322/654] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:06.009296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.042954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 333/655] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:06.042954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.121261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.126124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e12b-4797-4ac9-bc1d-d36fce610099 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.140122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7644b6f-2adf-4a85-a716-c7ada4093436 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.152193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.165924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.166820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.167333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.167879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.168693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:06.169163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.170899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.179293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.179698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.179976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.180242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.180959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:06.181256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.182783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.190173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 323/656] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:06.191398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.201021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 334/657] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:06.202082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.298502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542168f3-5de8-433b-bf58-a458c15ab2e4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.308925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6eb7-9551-4e82-82d0-c3610168efba None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.333082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.333739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.334011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.334282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.344113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfdb4a-33bc-41c4-93a8-627f5082b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.344721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfdb4a-33bc-41c4-93a8-627f5082b703 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.344941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.345043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfdb4a-33bc-41c4-93a8-627f5082b703 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.345246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfdb4a-33bc-41c4-93a8-627f5082b703 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.346984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.352853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfdb4a-33bc-41c4-93a8-627f5082b703 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.354293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfdb4a-33bc-41c4-93a8-627f5082b703 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.357138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:06.361677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:06.363247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:06.364122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:06.364122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:06.364122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:06.364122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 324/658] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:06.364918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-fddfdb4a-33bc-41c4-93a8-627f5082b703 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:06.370023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:06.370964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 04:04:06.371903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:06.373833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 335/659] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:06.375166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5558-1aef-46d7-b494-68594da0beee None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.375613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5558-1aef-46d7-b494-68594da0beee None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.376048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5558-1aef-46d7-b494-68594da0beee None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.377499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 336/660] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:06.378908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5558-1aef-46d7-b494-68594da0beee None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.406330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.476786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562c278-e7f3-4beb-87fd-59dd7b30ea03 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.493026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5558-1aef-46d7-b494-68594da0beee None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.512886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b945907-57f2-4205-945c-06c59f60cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.513495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b945907-57f2-4205-945c-06c59f60cae3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.514224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b945907-57f2-4205-945c-06c59f60cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.514500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b945907-57f2-4205-945c-06c59f60cae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.530043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.530637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.530910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.531172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.531805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:06.532098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.533448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.550674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 337/661] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:06.550674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.600582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b945907-57f2-4205-945c-06c59f60cae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.602206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b945907-57f2-4205-945c-06c59f60cae3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.609923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.637519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.659135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56c7fb-022c-4154-a188-57fe0d0b5e56 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.704496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.705092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.705371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.705703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.706487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:06.706808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.708272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.709638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 325/662] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:06.710694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144806a4-b842-444a-bda0-9bc15b317a5f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.710970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144806a4-b842-444a-bda0-9bc15b317a5f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.711234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144806a4-b842-444a-bda0-9bc15b317a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.728683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-144806a4-b842-444a-bda0-9bc15b317a5f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:06.729892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-144806a4-b842-444a-bda0-9bc15b317a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:06.735962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 338/663] 10.222.0.69 () {56 vars in 1139 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:06.735962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.805713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 326/664] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:06.805713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144806a4-b842-444a-bda0-9bc15b317a5f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.841769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eee9b0-b934-4abf-8d08-c342246a6608 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.862746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.883161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.883817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.884094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.884365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.886486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.891655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:06.893001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:06.904691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:06.905714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:06.906681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:06.910041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 339/665] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:06.910813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:06.938702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144806a4-b842-444a-bda0-9bc15b317a5f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:06.984526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:06.986053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.986817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.987275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.005680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.007750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.022452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914b59b-a146-449b-8c14-493d6db0130c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:07.028340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:07.029285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:07.030907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:07.030907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:07.030907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:07.032348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 327/666] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:07.033304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.065395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.066243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.066836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.067176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.127130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.152584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba865780-4270-4e72-aac2-2e718570f19f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.159200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.161234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.169306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.189447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.190750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.191026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.191298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.191979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:07.192281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.193986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.211132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 328/667] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:07.211132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.275208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 340/668] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:07.276211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.309714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738c12-0c89-4d04-87f0-c7aa73106e48 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.346115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.347021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.347297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.347571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.348362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:07.349442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.350834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.357229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.363177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 329/669] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:07.363980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.387885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea1119-e916-47f6-8ab4-8f4190008098 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.402948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.427365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.428207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.428488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.428934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.439647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:07.445039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:07.446095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:07.447026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:07.451017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 341/670] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:07.451860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.475627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788411b4-769f-4d5c-88ea-7ef82009658b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.510064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.510663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.510944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.511213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.511936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=94e017d6c128460eb8506dfb32697f74) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:07.512240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.513690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.520107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 330/671] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/role_assignments?user.id=94e017d6c128460eb8506dfb32697f74&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:07.520789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.561458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23771c40-510e-4b8d-a34f-df83a7f0dfa9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.605808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.607006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.608263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.608706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.618569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.625557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.627359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.639397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.642805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728f28-49fe-4210-9ca2-3803edbe11bc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:07.644705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:07.645723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:07.646641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:07.646641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:07.646641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:07.646641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 342/672] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:07.646641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.687460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d0ca1-280f-4d24-9b88-c213783c37e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.687460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d0ca1-280f-4d24-9b88-c213783c37e1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.687460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d0ca1-280f-4d24-9b88-c213783c37e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.687849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d0ca1-280f-4d24-9b88-c213783c37e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.694498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d0ca1-280f-4d24-9b88-c213783c37e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.695826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d0ca1-280f-4d24-9b88-c213783c37e1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e97d0ca1-280f-4d24-9b88-c213783c37e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:07.708345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:07.709474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:07.710580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 331/673] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:07.711193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024207-0dad-4652-bfb0-0434bad16c22 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.711193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024207-0dad-4652-bfb0-0434bad16c22 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.711358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024207-0dad-4652-bfb0-0434bad16c22 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.712458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 332/674] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:07.713211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024207-0dad-4652-bfb0-0434bad16c22 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.770727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10080f2-3275-4c63-8062-3aa582c84c78 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.805461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.806078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.806350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.806614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.807260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:07.807610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.808984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.816812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 343/675] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:07.817599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.833037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024207-0dad-4652-bfb0-0434bad16c22 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.870537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74323f3e-f1ce-4129-8b3b-fb99493a13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.871171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.872681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323f3e-f1ce-4129-8b3b-fb99493a13f6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.872961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323f3e-f1ce-4129-8b3b-fb99493a13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.873233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74323f3e-f1ce-4129-8b3b-fb99493a13f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.874085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323f3e-f1ce-4129-8b3b-fb99493a13f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:07.874419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323f3e-f1ce-4129-8b3b-fb99493a13f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.876103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74323f3e-f1ce-4129-8b3b-fb99493a13f6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.889064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 333/676] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:07.890354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d656-5354-434d-bda8-2115ae0895e1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.890637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d656-5354-434d-bda8-2115ae0895e1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.890907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d656-5354-434d-bda8-2115ae0895e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.910186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6831d656-5354-434d-bda8-2115ae0895e1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:07.911430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6831d656-5354-434d-bda8-2115ae0895e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:07.924264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984627a1-47be-41e0-b546-0994ac3cca27 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:07.926278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.959342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:07.959854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.960128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.960405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.961114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:07.961435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:07.962859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:07.976420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 344/677] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:07.977229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:07.996518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 334/678] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:07.997420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d656-5354-434d-bda8-2115ae0895e1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.084781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846c5a-2d02-47ea-b5f4-78bca0652203 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.110864 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:08.113776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d656-5354-434d-bda8-2115ae0895e1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.125190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.125846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.126119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.126383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.139566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:08.141278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:08.154753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.155693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.156214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.156692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:08.158008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:08.159008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:08.159922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:08.159922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:08.159922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:08.161706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 345/679] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:08.162715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.170878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:08.172320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:08.187401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:08.188362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 335/680] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:08.189921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.205445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:08.289204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6797db4-2552-4e5d-a2ec-8d01257605a8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.309346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d69df-05b4-4a99-9c78-d2a47282c4aa None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.330481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.331245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.331618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.331989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.332815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=aa77ec9b56cd4027b22fbe0d7ff3ee1d) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:08.333222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:08.335093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:08.343117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 346/681] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/role_assignments?user.id=aa77ec9b56cd4027b22fbe0d7ff3ee1d&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:08.343913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.358477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.359415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.359834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.360255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.361187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:08.361692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:08.363838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:08.382577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 336/682] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:08.383836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.389723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:08.483010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:08.493847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2756b33-07d1-4ef0-be28-94e64adb9d22 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.533559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2a840-75fe-4d26-beef-7ef9874282e6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.544335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.544335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.544335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.544335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.544760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:08.545677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:08.547455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:08.564915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 347/683] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:08.570148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.581019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.581925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.582358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.582774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.602486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:08.609967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:08.611093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:08.612733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 337/684] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:08.614008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.696008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:08.714173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028d0f1-83e3-44f6-a840-5a2e0ecf8f99 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.735542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194d6b7-b11b-4c3f-8e8b-c1d35f671791 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:08.765776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.767054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.767964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.769077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.770730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:08.777819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:08.778562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:08.778933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:08.779312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:08.780135 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=f520107f73aa48f791461922a3d6ec4b) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:08.780598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:08.780713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:08.782233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:08.782587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:08.789887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 338/685] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/role_assignments?user.id=f520107f73aa48f791461922a3d6ec4b&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:08.795631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:08.804115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:08.805280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:08.806286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:08.811400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 348/686] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:08.812112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:08.998334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68ec2a-7c81-4e34-905d-b9863623b9f8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.004748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670a65-975b-491e-b0d0-5e124a36293a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.039570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.040203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.040695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.040970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.042392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:09.042705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.044149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.047395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.048008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.048286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.048555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.049213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:09.050503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.051943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.062248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 339/687] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:09.067978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 349/688] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 30 04:04:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:09.071527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:09.073731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:09.084909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:09.144443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:09.195373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43578b87-a991-4581-8690-0a9961ca51e3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.200792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb02cc-ef35-4f2f-9535-9722f819b3dd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.238968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.240015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.240621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.241095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.253103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.255011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.261160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.262073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.263406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.263897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:09.285537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:09.286588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:09.287518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:09.287518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:09.287518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:09.289381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 340/689] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:09.295162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:09.375294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.376748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.389591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:09.480639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 350/690] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:04:09.486086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:09.575496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0bd9c-dd71-4067-b64b-f8b6d5712a90 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.600314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:09.619290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07584-cf58-47b0-a704-3a4252f047c6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.629916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:09.647406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.648108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.648450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.649559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.650287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:09.653314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.654781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.681076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 341/691] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:09.682257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:09.690189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66258703-4519-47b1-8438-ec8c39d928a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.690910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258703-4519-47b1-8438-ec8c39d928a8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.691251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258703-4519-47b1-8438-ec8c39d928a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.691582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258703-4519-47b1-8438-ec8c39d928a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.710499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66258703-4519-47b1-8438-ec8c39d928a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.713774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66258703-4519-47b1-8438-ec8c39d928a8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-66258703-4519-47b1-8438-ec8c39d928a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:09.733441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:09.734728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:09.735853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:09.735853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:09.735853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:09.741451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 351/692] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:09.742943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e64b-42a4-4b87-beed-c98bfc8cb434 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.743323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e64b-42a4-4b87-beed-c98bfc8cb434 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.743697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750e64b-42a4-4b87-beed-c98bfc8cb434 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.745474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 352/693] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:09.746266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750e64b-42a4-4b87-beed-c98bfc8cb434 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:09.832973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf19e06-6256-47e3-8598-d64ef885e0c5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.856998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750e64b-42a4-4b87-beed-c98bfc8cb434 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:09.876614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cbe3f-bc4f-48a6-8098-5b26f4682fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.877423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cbe3f-bc4f-48a6-8098-5b26f4682fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.878862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cbe3f-bc4f-48a6-8098-5b26f4682fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.879289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cbe3f-bc4f-48a6-8098-5b26f4682fb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.889129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cbe3f-bc4f-48a6-8098-5b26f4682fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.890940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cbe3f-bc4f-48a6-8098-5b26f4682fb0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.893325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:09.894675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.895060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.895440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.896217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:09.896614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:09.898085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-251cbe3f-bc4f-48a6-8098-5b26f4682fb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:09.905089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:09.906240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:09.907379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:09.910092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 342/694] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:04:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:09.911366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7963-f65b-464a-ba96-f2c182bf1866 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:09.911770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7963-f65b-464a-ba96-f2c182bf1866 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:09.912175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c7963-f65b-464a-ba96-f2c182bf1866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:09.918964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 353/695] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:09.919875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:09.935401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-365c7963-f65b-464a-ba96-f2c182bf1866 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:09.936580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-365c7963-f65b-464a-ba96-f2c182bf1866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:09.949581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:09.963614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:10.012979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 343/696] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:10.014041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7963-f65b-464a-ba96-f2c182bf1866 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.051356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b175a4-78a6-4b58-ab24-d42d3b5e26ca None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.122033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:10.122642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.122919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.123184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.123916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:10.124217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:10.125858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:10.161572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 354/697] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:04:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:10.165376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.183452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c7963-f65b-464a-ba96-f2c182bf1866 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.249720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:10.250359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.250633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.250900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.264069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:10.265548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:10.284624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:10.285602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:10.286482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 344/698] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:10.291484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.315793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:10.317196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:10.342153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358a150-1e70-44c0-97c4-40d8361d5094 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.377830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:10.378428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.378699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.378963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.422995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea38b48-8ab9-4010-a071-27747c993d1c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.457857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:10.459507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:10.462943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:10.463785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.464243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.464678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.465587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:10.466326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:10.467932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:10.481896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 345/699] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:10.483038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.560406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:10.592634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:10.612069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 355/700] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:04:10.613379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.621095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f35ed-01a7-46a2-8ce7-e71a5a269bb3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.661266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:10.662231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.662509 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.662784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.663367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:10.664719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:10.675927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:10.677268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:10.678400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 346/701] 10.222.0.69 () {56 vars in 1129 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:10.679373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.739860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43903f1f-3334-4e70-959c-34d745db31ad None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.777456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41777408-6e37-4233-a4b7-da8d11b624fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:10.778381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777408-6e37-4233-a4b7-da8d11b624fe None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.778839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777408-6e37-4233-a4b7-da8d11b624fe None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.779106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41777408-6e37-4233-a4b7-da8d11b624fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.779813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41777408-6e37-4233-a4b7-da8d11b624fe None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=16ba94b3c081488a851579dc5883427b) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:10.780113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41777408-6e37-4233-a4b7-da8d11b624fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:10.781529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41777408-6e37-4233-a4b7-da8d11b624fe None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:10.787396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e395e4-f7b9-41c6-abf2-39005e26b66c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.787903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 356/702] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/role_assignments?user.id=16ba94b3c081488a851579dc5883427b&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:10.789219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e16bc-9f31-4b83-b6a8-0adb8abbc77a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.789527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e16bc-9f31-4b83-b6a8-0adb8abbc77a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.789836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e16bc-9f31-4b83-b6a8-0adb8abbc77a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.791419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 357/703] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:10.791870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e16bc-9f31-4b83-b6a8-0adb8abbc77a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.841661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f6f34-2302-4892-97a9-0cc444e21a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:10.842312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6f34-2302-4892-97a9-0cc444e21a55 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.842584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6f34-2302-4892-97a9-0cc444e21a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.842853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f6f34-2302-4892-97a9-0cc444e21a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.854856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f6f34-2302-4892-97a9-0cc444e21a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:10.856601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f6f34-2302-4892-97a9-0cc444e21a55 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:10.858742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:10.861247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-729f6f34-2302-4892-97a9-0cc444e21a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:10.879772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:10.880803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:10.881796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:10.881796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:10.881796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:10.888180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 347/704] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:10.888180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77ec9-e528-4115-8305-ee0cc89824e8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:10.888180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77ec9-e528-4115-8305-ee0cc89824e8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:10.888180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d77ec9-e528-4115-8305-ee0cc89824e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:10.908966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-09d77ec9-e528-4115-8305-ee0cc89824e8 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:10.910992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-09d77ec9-e528-4115-8305-ee0cc89824e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:10.953801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e16bc-9f31-4b83-b6a8-0adb8abbc77a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:10.995288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 348/705] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:10.996114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d77ec9-e528-4115-8305-ee0cc89824e8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:10.999823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.000426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.000700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.000966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.001615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:11.001916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.003817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.009395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 358/706] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:11.014474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.123986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d77ec9-e528-4115-8305-ee0cc89824e8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:11.126124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803d2a-2d3d-41cb-8d07-da9b0363adde None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:11.130627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:11.155638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:11.171326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffabd8-6feb-4d54-aa77-993fb00a3f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.172055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffabd8-6feb-4d54-aa77-993fb00a3f3b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.172322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffabd8-6feb-4d54-aa77-993fb00a3f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.172587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffabd8-6feb-4d54-aa77-993fb00a3f3b None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.173279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffabd8-6feb-4d54-aa77-993fb00a3f3b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:11.173531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffabd8-6feb-4d54-aa77-993fb00a3f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.175387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffabd8-6feb-4d54-aa77-993fb00a3f3b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.177994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.178597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.178864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.179126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.179773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:11.180175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.181544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.186007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 359/707] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 30 04:04:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:11.187663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe763d-3ed3-4176-8872-86339a6a59c8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.188171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe763d-3ed3-4176-8872-86339a6a59c8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.194578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe763d-3ed3-4176-8872-86339a6a59c8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.196908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 360/708] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:11.197558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 349/709] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:11.202263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91a8e-2f5b-412d-9c6c-cad596bd4399 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.202534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91a8e-2f5b-412d-9c6c-cad596bd4399 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.202800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b91a8e-2f5b-412d-9c6c-cad596bd4399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.206639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.230560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-99b91a8e-2f5b-412d-9c6c-cad596bd4399 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:11.235350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-99b91a8e-2f5b-412d-9c6c-cad596bd4399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:11.351530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 361/710] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:11.352934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b91a8e-2f5b-412d-9c6c-cad596bd4399 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.354066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ef17-c7e8-4935-ac72-4ec9c0c385ad None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:11.412339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.413220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.413704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.414124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.423891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.426680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:11.442623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:11.443610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:11.444550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:11.449584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 350/711] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:11.454849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.473567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b91a8e-2f5b-412d-9c6c-cad596bd4399 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:11.483693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:11.507501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:11.510462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.511164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.511502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.511836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.523774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.525230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:11.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:11.543200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:11.544516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:11.544516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:11.544516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:11.544516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 362/712] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:11.551210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.574036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387ff68-4854-4575-b68c-e75b02583821 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:11.610672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.611201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.611595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.612096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.613447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:11.613879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.615401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.632116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 351/713] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:11.635054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.739213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecf4a1-5782-40b6-97b8-3902a310ccdd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:11.741703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:11.760528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ed912-3818-43ec-a8f2-c885442cd6c5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:11.779887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.780496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.780809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.781081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.781844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=c8b82c351b9340ee88bbb4a9b490847f) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:11.782152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.783625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.797926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 352/714] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:11 2022] GET /identity/v3/role_assignments?user.id=c8b82c351b9340ee88bbb4a9b490847f&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:11.800985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.803448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:11.804560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.805042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.805546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.806406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:11.806912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:11.808708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:11.822560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 363/715] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:11.834717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:11.856096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:11.949023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988eb86-caa4-4d33-867a-268dc6939b49 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:12.017303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:12.017889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:12.018169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:12.018964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] PATH_INFO: `/v3/services/network` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:12.019548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:12.020918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:12.028123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d68785-1a25-47ca-90eb-23994567c2cf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:12.031599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:12.032643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:12.033556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 353/716] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:11 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:12.043366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:12.069938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:12.070925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:12.071411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:12.071879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:12.072738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:12.074386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:12.100482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 364/717] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:04:11 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:12.140297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:12.251522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc0ae-7696-414f-98d1-e45b10983e09 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:12.288529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ad0d1-5473-4809-9ddc-eaefc3d7067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:12.289050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ad0d1-5473-4809-9ddc-eaefc3d7067c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:12.289325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ad0d1-5473-4809-9ddc-eaefc3d7067c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:12.289628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ad0d1-5473-4809-9ddc-eaefc3d7067c None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:12.290257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ad0d1-5473-4809-9ddc-eaefc3d7067c None admin] RBAC: Adding query filter params (name=network) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:12.290555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ad0d1-5473-4809-9ddc-eaefc3d7067c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:12.291987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ad0d1-5473-4809-9ddc-eaefc3d7067c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:12.296997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 354/718] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:12.303016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:12.373548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:12.411702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc6f0b-3617-4307-a769-c02f78b39df3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:12.447886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f21b4-7604-4d19-87eb-63492cebf98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:12.448844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f21b4-7604-4d19-87eb-63492cebf98f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:12.449352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f21b4-7604-4d19-87eb-63492cebf98f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:12.449839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f21b4-7604-4d19-87eb-63492cebf98f None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:12.450663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f21b4-7604-4d19-87eb-63492cebf98f None admin] RBAC: Adding query filter params (type=network) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:12.451172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f21b4-7604-4d19-87eb-63492cebf98f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:12.452701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f21b4-7604-4d19-87eb-63492cebf98f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:12.461403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 365/719] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:13.253279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb935-eaf7-4374-ae52-063c91ee8893 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:13.253859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb935-eaf7-4374-ae52-063c91ee8893 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:13.253859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb935-eaf7-4374-ae52-063c91ee8893 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:13.255542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 355/720] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:13.260545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159be89-ad48-4a2c-9f85-24f7b1e64ac3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:13.260834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159be89-ad48-4a2c-9f85-24f7b1e64ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:13.261110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159be89-ad48-4a2c-9f85-24f7b1e64ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:13.279344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f159be89-ad48-4a2c-9f85-24f7b1e64ac3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:13.280536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f159be89-ad48-4a2c-9f85-24f7b1e64ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:13.348786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 366/721] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:13.613120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511f09-6e80-4feb-9576-b484c5c36ced None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:13.613438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511f09-6e80-4feb-9576-b484c5c36ced None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:13.613702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75511f09-6e80-4feb-9576-b484c5c36ced None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:13.615328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 356/722] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:13.620701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe3064-c800-479b-99f7-6d819081f546 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:13.620986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe3064-c800-479b-99f7-6d819081f546 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:13.621261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe3064-c800-479b-99f7-6d819081f546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:13.646195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-54fe3064-c800-479b-99f7-6d819081f546 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:13.647377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-54fe3064-c800-479b-99f7-6d819081f546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:13.675854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511f09-6e80-4feb-9576-b484c5c36ced None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:13.751245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:13.774498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 367/723] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:13.811773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:13.818860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75511f09-6e80-4feb-9576-b484c5c36ced None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:13.856256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:13.857272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:13.857776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:13.858265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:13.871681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:13.876843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:13.877831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:13.878663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:13.881205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 357/724] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:13.886781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe3064-c800-479b-99f7-6d819081f546 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:14.054285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe3064-c800-479b-99f7-6d819081f546 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:14.102772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:14.103380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.103659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.103931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.104596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:14.104898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:14.106347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:14.121150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 368/725] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:14.126597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:14.249113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:14.289745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311518e-5082-4c4d-9106-154cc4702a63 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:14.327573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:14.330217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3823c-a32e-4a91-89d2-e0c2b01dfb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:14.331651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3823c-a32e-4a91-89d2-e0c2b01dfb8e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.332499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3823c-a32e-4a91-89d2-e0c2b01dfb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.333142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3823c-a32e-4a91-89d2-e0c2b01dfb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.348513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3823c-a32e-4a91-89d2-e0c2b01dfb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:14.350003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3823c-a32e-4a91-89d2-e0c2b01dfb8e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9bc3823c-a32e-4a91-89d2-e0c2b01dfb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:14.370232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:14.371423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:14.372559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:14.372559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:14.372559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:14.379939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 358/726] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:14.379939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9704-336e-44a3-b360-f9ff79ef4d1f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.379939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9704-336e-44a3-b360-f9ff79ef4d1f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.379939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9704-336e-44a3-b360-f9ff79ef4d1f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.381290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 359/727] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:14.382613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a9704-336e-44a3-b360-f9ff79ef4d1f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:14.391114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cccae-2715-4979-b36d-c37525b645d6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:14.402160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:14.442561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5ff8c-4cf5-4dfa-8239-2d91378171b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:14.444037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5ff8c-4cf5-4dfa-8239-2d91378171b3 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.444583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5ff8c-4cf5-4dfa-8239-2d91378171b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.445459 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5ff8c-4cf5-4dfa-8239-2d91378171b3 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.446770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5ff8c-4cf5-4dfa-8239-2d91378171b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:14.449202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5ff8c-4cf5-4dfa-8239-2d91378171b3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:14.478087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 369/728] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:14 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:14.480009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b7154-3ab0-436e-a286-3ed7390f7df3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.480499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b7154-3ab0-436e-a286-3ed7390f7df3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.481022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b7154-3ab0-436e-a286-3ed7390f7df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.514396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-649b7154-3ab0-436e-a286-3ed7390f7df3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:14.514396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-649b7154-3ab0-436e-a286-3ed7390f7df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:14.516688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a9704-336e-44a3-b360-f9ff79ef4d1f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:14.556899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bc46-cad9-46f9-a7da-942bfe39b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:14.557912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bc46-cad9-46f9-a7da-942bfe39b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.558327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bc46-cad9-46f9-a7da-942bfe39b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.558723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bc46-cad9-46f9-a7da-942bfe39b6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.559528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707bc46-cad9-46f9-a7da-942bfe39b6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:14.560037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707bc46-cad9-46f9-a7da-942bfe39b6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:14.561659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707bc46-cad9-46f9-a7da-942bfe39b6a5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:14.576823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 360/729] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:14.578625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9408ce-8214-4c0a-b9a3-4d4515a1eb76 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.579136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9408ce-8214-4c0a-b9a3-4d4515a1eb76 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.579623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9408ce-8214-4c0a-b9a3-4d4515a1eb76 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.581928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 361/730] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:14.582916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9408ce-8214-4c0a-b9a3-4d4515a1eb76 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:14.615471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 370/731] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:14.616885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc9519-6132-4ed9-89b4-c24e4d6516ea None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.617161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc9519-6132-4ed9-89b4-c24e4d6516ea None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.617428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc9519-6132-4ed9-89b4-c24e4d6516ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.637558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d1fc9519-6132-4ed9-89b4-c24e4d6516ea None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:14.639199 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d1fc9519-6132-4ed9-89b4-c24e4d6516ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:14.661922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:14.699926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9408ce-8214-4c0a-b9a3-4d4515a1eb76 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:14.730540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:14.740232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:14.741131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.741821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.742254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.751418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:14.753437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:14.765519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:14.766492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:14.767461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:14.769815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 362/732] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:14.775825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:14.778428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 371/733] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:14.881997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b95ed0-85f0-408e-8392-735bd832c48c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:14.909954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:14.918194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:14.918808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.919152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.919529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.920267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:14.920959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:14.922445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:14.945479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 363/734] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 30 04:04:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:14.946869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc9519-6132-4ed9-89b4-c24e4d6516ea None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:14.948789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.062197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc9519-6132-4ed9-89b4-c24e4d6516ea None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.077238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3e5fa-0383-4639-8739-d421c16a1d01 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.098721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433f5b4-ffdb-4122-9635-36e94e3c72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.099353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433f5b4-ffdb-4122-9635-36e94e3c72fb None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.099631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433f5b4-ffdb-4122-9635-36e94e3c72fb None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.099902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433f5b4-ffdb-4122-9635-36e94e3c72fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.110882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433f5b4-ffdb-4122-9635-36e94e3c72fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:15.115166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be943a69-34f2-45a0-95a3-64bc145cb6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.115769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be943a69-34f2-45a0-95a3-64bc145cb6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.116042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be943a69-34f2-45a0-95a3-64bc145cb6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.116316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be943a69-34f2-45a0-95a3-64bc145cb6a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3433f5b4-ffdb-4122-9635-36e94e3c72fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:15.116503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:15.117426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 372/735] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:15.122610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3fef7-73cf-4e67-b28a-ffeb3d042e6a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.123421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3fef7-73cf-4e67-b28a-ffeb3d042e6a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.123421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3fef7-73cf-4e67-b28a-ffeb3d042e6a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.123421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 373/736] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:15.123421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3fef7-73cf-4e67-b28a-ffeb3d042e6a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.155742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.184732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.204810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be943a69-34f2-45a0-95a3-64bc145cb6a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.206429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be943a69-34f2-45a0-95a3-64bc145cb6a1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.234093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3fef7-73cf-4e67-b28a-ffeb3d042e6a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.269266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.270304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.270734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.271153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.282719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:15.288885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:15.290064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:15.291068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:15.293388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 374/737] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:15.294257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.317963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 364/738] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 04:04:15.319810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a4c1-12a2-4a63-af07-185ad342907d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.320275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a4c1-12a2-4a63-af07-185ad342907d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.320725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7a4c1-12a2-4a63-af07-185ad342907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.338329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-53d7a4c1-12a2-4a63-af07-185ad342907d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:15.339509 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-53d7a4c1-12a2-4a63-af07-185ad342907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:15.396978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.406441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ff6c8-c1ea-424c-8ed1-38f763f2b35a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.418008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 365/739] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:04:15.418008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a4c1-12a2-4a63-af07-185ad342907d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.441362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.445011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.445691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.445972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.446247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.446898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:15.447197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.448550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.457568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 375/740] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:15.458313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.553586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7a4c1-12a2-4a63-af07-185ad342907d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.598687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b4fc3-0861-4639-9ed7-544f6273f24f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.604800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.605456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.605777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.606045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.606706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:15.607391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.608582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.618348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 366/741] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:15.619232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.641002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.641991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.642982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.643962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.662249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.664439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:15.684341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:15.685309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:15.686290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:15.686290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:15.686290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:15.687064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 376/742] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:15.687852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.700132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.704156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.730507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82874-e94a-425d-938f-9c31821a9b84 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.771667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.773061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.773340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.773640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.787643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.789106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.802081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debad98-2cf1-4c36-b927-b9e3eadcaf6d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:15.807261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:15.808211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:15.814180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:15.814180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:15.814180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:15.814180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 367/743] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:15.814180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.838136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.838755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.839028 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.839295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.850172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.851615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:15.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:15.868380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:15.869285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:15.869285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:15.869285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:15.869285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 377/744] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:15.869285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.933165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d4893-811c-45c2-bbf9-98b1dc0f96c5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.936454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.961409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.971731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.972342 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.972667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.972941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.973601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:15.973905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.975512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.983617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867894b-fae7-4149-8b12-d8a41bac0418 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.992360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 368/745] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:15.992360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.021170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.021801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.022105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.022531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.023016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.024355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.039458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 378/746] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:15 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:16.040075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.112597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86e0bf-3092-41f8-9fab-60279bf42fae None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.157685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.158299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.158582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.158855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.159627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:16.159932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.161340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.172889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e038c95-b9b1-4e7f-b740-a35f602f27e8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.179092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 369/747] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:16.180244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.194474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:16.214532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.215411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.215883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.216584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.217394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:16.218635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.220179 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.230397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:16.236409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 379/748] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:16.239533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.303856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b7029-eca6-4845-8889-a95eca606ce9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.341805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.342468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.342803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.343077 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.349309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33eb7bd-1715-453e-89b8-9cb1088cf6da None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.351234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.353322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:16.368982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:16.369925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:16.370820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 370/749] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:16.371884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.386385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.387011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.387288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.387559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.395560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.397048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:16.410405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:16.412667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 380/750] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:16.414664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.476186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:16.488794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d520-6a68-42e3-aebb-d3fdce4710db None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.490550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:16.532042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.532934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.533697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.533985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.545062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.547213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.553720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715c4b4-3487-4a3f-9b59-6246598aedf7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:16.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:16.564167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 371/751] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:16.565382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.597501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.598138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.598466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.598852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.599644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:16.599854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.601482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.620448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 381/752] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:16.621638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.698114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dc117-73a6-4720-ad35-aaa1524081ab None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.735667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.736189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.736558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.737163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.738681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:16.738794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.740221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.754162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:16.758622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c7a88-dfbb-4d69-9b91-8f4666fec4b4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.764008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 372/753] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:16.764008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.787181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:16.801605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5dece-7d99-427a-b599-48f73c60984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.802402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5dece-7d99-427a-b599-48f73c60984e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.802676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5dece-7d99-427a-b599-48f73c60984e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.802947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5dece-7d99-427a-b599-48f73c60984e None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.803670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5dece-7d99-427a-b599-48f73c60984e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:16.803973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5dece-7d99-427a-b599-48f73c60984e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.805372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5dece-7d99-427a-b599-48f73c60984e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.827721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 382/754] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:16.827721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325240a9-0891-42c9-8ddb-bbf1d0ba18db None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.827721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325240a9-0891-42c9-8ddb-bbf1d0ba18db None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.827721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325240a9-0891-42c9-8ddb-bbf1d0ba18db None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.827721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 383/755] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:16.827721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325240a9-0891-42c9-8ddb-bbf1d0ba18db None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.880890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1bbe-cd03-41e6-8d40-ffaebea1ce10 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.918487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.919091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:16.919434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:16.919710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:16.920694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=16ba94b3c081488a851579dc5883427b) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:16.921267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:16.923532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:16.932020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 373/756] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/role_assignments?user.id=16ba94b3c081488a851579dc5883427b&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:16.932020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:16.949315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325240a9-0891-42c9-8ddb-bbf1d0ba18db None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:16.998633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7ca5e-98bc-4fef-95f4-206798b3bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:16.999625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7ca5e-98bc-4fef-95f4-206798b3bd0d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.000169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7ca5e-98bc-4fef-95f4-206798b3bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.000739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7ca5e-98bc-4fef-95f4-206798b3bd0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.013834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7ca5e-98bc-4fef-95f4-206798b3bd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.015639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7ca5e-98bc-4fef-95f4-206798b3bd0d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-34b7ca5e-98bc-4fef-95f4-206798b3bd0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:17.032949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:17.034012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:17.034990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:17.034990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:17.034990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:17.042008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:17.042351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 384/757] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:17.044397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8aad-a9f4-4ab7-9324-1df1ebcd0e16 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.044929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8aad-a9f4-4ab7-9324-1df1ebcd0e16 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.045392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8aad-a9f4-4ab7-9324-1df1ebcd0e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.052969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475b6a3-b6af-45be-b344-2cfb9ce72149 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:17.067629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8a5d8aad-a9f4-4ab7-9324-1df1ebcd0e16 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:17.069151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8a5d8aad-a9f4-4ab7-9324-1df1ebcd0e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:17.072793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:17.095420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:17.096039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.096318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.096588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.171710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 385/758] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:17.171710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8aad-a9f4-4ab7-9324-1df1ebcd0e16 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:17.181493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.182984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.296458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:17.314983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 374/759] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:17.322218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:17.375230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8aad-a9f4-4ab7-9324-1df1ebcd0e16 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:17.442877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:17.443516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.443750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.444017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.444664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:17.444973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.446441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.452941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98697504-6a0e-4d5b-9eed-0dd07ed119a1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:17.464469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:17.470261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 386/760] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:17.477826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:17.498044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:17.499061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.499630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.500146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.511218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.512921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:17.531640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:17.532609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:17.533485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:17.533485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:17.533485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:17.537015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 375/761] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:17.545037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:17.594236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:17.646980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8094ae0-c951-4e20-9778-1f10a359fad0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:17.683370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:17.684396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.684865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.685325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.689259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189184cf-5ed6-4404-9af8-41ac53e87373 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:17.693253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.694926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:17.706979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:17.707906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:17.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:17.715646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 387/762] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:17.716979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:17.728753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:17.729372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.729681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.729952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.731065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:17.731371 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.733155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.755727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 376/763] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:17.756694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:17.787186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:17.829951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ba24-873f-4acd-bb2d-0c3280dd0118 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:17.861550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:17.866498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:17.867466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.867947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.868406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.869174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.869433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1caa9f-3033-4937-aa55-f625bbc8acfe None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:17.870949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:17.885419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:17.886680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:17.887726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:17.890659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 388/764] 10.222.0.69 () {56 vars in 1129 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:17.892039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:17.927723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:17.928350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:17.928631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:17.929026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:17.929630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:17.930049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:17.931585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:17.951797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 377/765] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:17.951797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.028247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0e4a-1f62-4e28-9a97-d69141ec3796 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.053749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:18.072023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.073036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.074069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.074548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.084416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.085993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.087582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e509-619e-41f6-b556-b10e51be8cd9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:18.097767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:18.098700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 389/766] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:18.099612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.127085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b742492-afdd-4808-884d-1756f53701e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.127610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742492-afdd-4808-884d-1756f53701e3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.128464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742492-afdd-4808-884d-1756f53701e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.128761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b742492-afdd-4808-884d-1756f53701e3 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.129397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b742492-afdd-4808-884d-1756f53701e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:18.129732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b742492-afdd-4808-884d-1756f53701e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.131110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b742492-afdd-4808-884d-1756f53701e3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.136474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 378/767] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 30 04:04:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:18.137642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c52036-6b36-4be2-aa30-020a6e9ca150 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.137991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c52036-6b36-4be2-aa30-020a6e9ca150 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.138332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c52036-6b36-4be2-aa30-020a6e9ca150 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.141562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 379/768] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:18.141562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c52036-6b36-4be2-aa30-020a6e9ca150 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.165107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:18.218424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9688ae-2826-4844-95d3-9d8fe91dacd1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.253811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c52036-6b36-4be2-aa30-020a6e9ca150 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.258304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.258989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.259262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.259530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/c8b82c351b9340ee88bbb4a9b490847f/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.261973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=c8b82c351b9340ee88bbb4a9b490847f, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.265262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.283309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 390/769] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:18 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/c8b82c351b9340ee88bbb4a9b490847f/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:04:18.283936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.321881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb651c-d6fc-4d9f-83cb-42579fad0947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.322911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb651c-d6fc-4d9f-83cb-42579fad0947 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.323500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb651c-d6fc-4d9f-83cb-42579fad0947 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.323985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb651c-d6fc-4d9f-83cb-42579fad0947 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.325985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb651c-d6fc-4d9f-83cb-42579fad0947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:18.326196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb651c-d6fc-4d9f-83cb-42579fad0947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.327698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb651c-d6fc-4d9f-83cb-42579fad0947 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.337945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:18.351014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 380/770] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:18.352751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e1ac5-ba93-4fcc-9507-acc9469b346a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.353763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e1ac5-ba93-4fcc-9507-acc9469b346a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.354219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e1ac5-ba93-4fcc-9507-acc9469b346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.380885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3c7e1ac5-ba93-4fcc-9507-acc9469b346a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:18.383139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3c7e1ac5-ba93-4fcc-9507-acc9469b346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:18.414506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c4d0e-4222-4c01-95fe-3bcc315195ef None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.460749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.462141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.462575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.462891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.463469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:18.463915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.465110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.471342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 391/771] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 30 04:04:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:18.472269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.472404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 381/772] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:18.478063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e1ac5-ba93-4fcc-9507-acc9469b346a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.501124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:18.608401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe681d8-6757-401d-9c97-223834ffb8ed None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.617005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:18.627496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e1ac5-ba93-4fcc-9507-acc9469b346a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.647328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.647928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.648206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.648474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.649198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=0d67ec68dae046f0b5ae1b2c30b04a20) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:18.649500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.650937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.657437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 392/773] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:18 2022] GET /identity/v3/role_assignments?user.id=0d67ec68dae046f0b5ae1b2c30b04a20&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:18.682908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.683925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.684355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.684775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.685681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] RBAC: Adding query filter params (interface=public, service_id=fa3fcac994c747539c07b68080164a0d, region_id=RegionOne) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:18.686142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.687724 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.701453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 382/774] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:04:18 2022] GET /identity/v3/endpoints?service_id=fa3fcac994c747539c07b68080164a0d&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:18.707126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.851399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36bc1d-ddc0-45be-8451-7ac53bd4c6d9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:18.898610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4382d-ddce-4308-a4f3-6d3a1187952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:18.899132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4382d-ddce-4308-a4f3-6d3a1187952d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.899411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4382d-ddce-4308-a4f3-6d3a1187952d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.899667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4382d-ddce-4308-a4f3-6d3a1187952d None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.900267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4382d-ddce-4308-a4f3-6d3a1187952d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:18.901640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4382d-ddce-4308-a4f3-6d3a1187952d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:18.907125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 393/775] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:18 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:18.947150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:19.037893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefac9b3-87b2-49c7-acd7-bedc56989fa4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.038250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefac9b3-87b2-49c7-acd7-bedc56989fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.038434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefac9b3-87b2-49c7-acd7-bedc56989fa4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.039953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 394/776] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:19.046547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0db7b-9ade-48d5-8baf-d2cb46a03300 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.046820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0db7b-9ade-48d5-8baf-d2cb46a03300 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.047080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0db7b-9ade-48d5-8baf-d2cb46a03300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.057538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.072768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6da0db7b-9ade-48d5-8baf-d2cb46a03300 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:19.074015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6da0db7b-9ade-48d5-8baf-d2cb46a03300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:19.111462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.120029 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcb603-5fb1-417d-be6a-0fe4fb5733bf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:19.156956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 395/777] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:19.161812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:19.162654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.163078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.164270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] PATH_INFO: `/v3/services/network` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.165020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:19.166559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:19.176363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:19.177682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:19.178746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:19.181397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 383/778] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:18 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:19.189191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0db7b-9ade-48d5-8baf-d2cb46a03300 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:19.287588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0db7b-9ade-48d5-8baf-d2cb46a03300 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:19.321431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:19.322214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.322582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.322944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.323658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:19.324050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:19.325489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:19.330407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 396/779] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:19.338576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:19.479255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9560543-36ef-4cb8-bf66-03cf643bf978 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:19.533692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:19.535193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.535715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.536182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.537233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] RBAC: Adding query filter params (type=network) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:19.537746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:19.540110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:19.550856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 384/780] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:19.558607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:19.601927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.622728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:19.627339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.699651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9496f-dab8-4327-a9e9-676295d9cae3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:19.772742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:19.773686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.774145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.775285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.776178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] RBAC: Adding query filter params (interface=public, service_id=eb71e3de545f406da1c5c76db2228451, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:19.777203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:19.780084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:19.782882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717755e4-29da-404a-af02-4a9662bde322 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:19.797797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 397/781] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:04:19 2022] GET /identity/v3/endpoints?service_id=eb71e3de545f406da1c5c76db2228451&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:19.805329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:19.867605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:19.868354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.868596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.868868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.890510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:19.896407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:19.897386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:19.898307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:19.905929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 385/782] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:19.909075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.912256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:19.919670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4552909-080a-4f18-adf6-139d572d4b8e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:19.957422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:19.958975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.959463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.959991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.960956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:19.963461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:19.969563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 398/783] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:19 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:20.033201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:20.098140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f692a-8add-47cf-b1ee-fa4ff271a340 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:20.149258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:20.150299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:20.150804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:20.151299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:20.152176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:20.152691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:20.154381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:20.167277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 386/784] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:20.173204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:20.281157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454965b-31ea-4fb1-adec-26cd4a7e0b5a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:20.319958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:20.320921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:20.321434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:20.321936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:20.334066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:20.335802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:20.350991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:20.352001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:20.352910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:20.352910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:20.352910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:20.355057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 399/785] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:20.360287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:20.470069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88c82b-1553-4939-8746-fde277cf76bb None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:20.495398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:20.506641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:20.507253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:20.507532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:20.507801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:20.508449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:20.508749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:20.510136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:20.522809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 387/786] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:20.530614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:20.557977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:20.655706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785cf9a-c7e4-43d2-b72d-573777baa0fe None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:20.690910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28d63e-3f18-43b3-9273-aa2ee12785b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:20.691599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d63e-3f18-43b3-9273-aa2ee12785b0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:20.691879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d63e-3f18-43b3-9273-aa2ee12785b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:20.692148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d63e-3f18-43b3-9273-aa2ee12785b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:20.699959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28d63e-3f18-43b3-9273-aa2ee12785b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:20.701396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28d63e-3f18-43b3-9273-aa2ee12785b0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-7e28d63e-3f18-43b3-9273-aa2ee12785b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:20.713168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:20.714172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:20.715147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 400/787] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:20.721671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:20.845060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21cd7-0620-4ab9-910c-6d34a7b37de5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:20.859675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a44b-3e2f-42e2-91b4-9c97c78e1f72 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:20.859949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a44b-3e2f-42e2-91b4-9c97c78e1f72 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:20.860216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a44b-3e2f-42e2-91b4-9c97c78e1f72 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:20.861715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 401/788] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:20.866881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db1d3-85b3-4cce-9345-716313ecb0c6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:20.867413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db1d3-85b3-4cce-9345-716313ecb0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:20.867906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db1d3-85b3-4cce-9345-716313ecb0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:20.892178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f01db1d3-85b3-4cce-9345-716313ecb0c6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:20.895139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f01db1d3-85b3-4cce-9345-716313ecb0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:20.914323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:20.915295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:20.915817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:20.916280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:20.917294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:20.917921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:20.919552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:20.957101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 388/789] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 30 04:04:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:20.966813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.001884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.008167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 402/790] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:21.009582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf58f-64a9-40f6-b0ed-340a730175d3 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.010213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf58f-64a9-40f6-b0ed-340a730175d3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.010843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf58f-64a9-40f6-b0ed-340a730175d3 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.016204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 403/791] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:21.017395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7348-e812-44cf-967f-b5adb517e5df None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.017777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7348-e812-44cf-967f-b5adb517e5df None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.018110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7348-e812-44cf-967f-b5adb517e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.026386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.038363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-aaba7348-e812-44cf-967f-b5adb517e5df None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:21.039699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aaba7348-e812-44cf-967f-b5adb517e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:21.090256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5933e-1b40-462c-80e6-c82e022a32cf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:21.123047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 404/792] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:21.172025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:21.172661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.172940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.173205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.193771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:21.195242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:21.219007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:21.219983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:21.220916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:21.220916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:21.220916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:21.220916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 389/793] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:21.227235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7348-e812-44cf-967f-b5adb517e5df None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.317101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.354084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7348-e812-44cf-967f-b5adb517e5df None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:21.411047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.424368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:21.425353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.425655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.426905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.427556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:21.427855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:21.429221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:21.459301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 405/794] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:21.464769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.499150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.507072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319d58-2fcc-4437-9ee2-96c7b42ea84b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:21.544754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:21.545379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.545692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.545972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.555925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:21.561108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:21.562290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:21.563313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 390/795] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:21.564013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.587362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45d86a-6471-4296-a4c4-ccc7f3a3ba5d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:21.627654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d837-0872-480e-89dc-efcef6b3ae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:21.628594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d837-0872-480e-89dc-efcef6b3ae7f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.628867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d837-0872-480e-89dc-efcef6b3ae7f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.629128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d837-0872-480e-89dc-efcef6b3ae7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.637622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606d837-0872-480e-89dc-efcef6b3ae7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:21.639775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606d837-0872-480e-89dc-efcef6b3ae7f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-7606d837-0872-480e-89dc-efcef6b3ae7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:21.654143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:21.655034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 406/796] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778d9c-760a-4d75-8f0c-5511bc0eda18 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.662438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778d9c-760a-4d75-8f0c-5511bc0eda18 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.663057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778d9c-760a-4d75-8f0c-5511bc0eda18 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.663057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 407/797] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:21.663057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24778d9c-760a-4d75-8f0c-5511bc0eda18 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.672478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34bea-401b-4e00-98fa-3cb0a54e11e5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:21.710091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:21.711027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.711314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.711900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.716805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.726361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:21.733268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:21.734350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:21.735193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:21.735893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 391/798] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:21.736365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.753440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.776736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24778d9c-760a-4d75-8f0c-5511bc0eda18 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:21.812427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168b02-6dc0-4da1-abba-cf4f16ef8a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:21.813015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168b02-6dc0-4da1-abba-cf4f16ef8a19 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.813297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168b02-6dc0-4da1-abba-cf4f16ef8a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.813594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168b02-6dc0-4da1-abba-cf4f16ef8a19 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.814252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168b02-6dc0-4da1-abba-cf4f16ef8a19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:21.814552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168b02-6dc0-4da1-abba-cf4f16ef8a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:21.816423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168b02-6dc0-4da1-abba-cf4f16ef8a19 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:21.826351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 408/799] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:21.826351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06799a-caec-41ce-9ef4-418377ad12ad None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.826351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06799a-caec-41ce-9ef4-418377ad12ad None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.826351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06799a-caec-41ce-9ef4-418377ad12ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.846647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1a06799a-caec-41ce-9ef4-418377ad12ad None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:21.847875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a06799a-caec-41ce-9ef4-418377ad12ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:21.856160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec019e-d57f-4ffa-beea-41f9de15d373 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:21.892154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:21.892765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.893043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.893317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.894694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:21.895003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:21.896446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:21.908349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 392/800] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:21.909146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.934955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 409/801] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:21.936177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06799a-caec-41ce-9ef4-418377ad12ad None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:21.989331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.008328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.018401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314ac1c-e464-4157-839d-27ee9b72d94a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.056436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.057189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.057599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.057971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.058753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:22.059149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.060620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.073685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 393/802] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:22.074628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.085792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06799a-caec-41ce-9ef4-418377ad12ad None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.133794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.134518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.134797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.135140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.147040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.148574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:22.164948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:22.165962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:22.166874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:22.166874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:22.166874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:22.171118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 410/803] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:22.172025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.188129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de89c-0ada-4313-a113-da9cc8d6568f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.224371 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.225041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.225329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.225615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/16ba94b3c081488a851579dc5883427b/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.227546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=16ba94b3c081488a851579dc5883427b, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.228971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.232700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.245693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 394/804] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:22 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/16ba94b3c081488a851579dc5883427b/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:04:22.246513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.293068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.302595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae89d9c-337c-404f-8c9c-509a4d416968 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.340031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.340669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.340944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.341220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.353477 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.354959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.359608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c36492-baf7-4f20-90cc-f7467e56f7ed None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:22.371389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:22.372624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:22.373866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:22.373866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:22.373866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:22.377422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 411/805] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:22.378441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.408033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3375eca-f446-4ff0-bf83-e43bf3fbc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.408652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375eca-f446-4ff0-bf83-e43bf3fbc1eb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.408931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375eca-f446-4ff0-bf83-e43bf3fbc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.409205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3375eca-f446-4ff0-bf83-e43bf3fbc1eb None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.410448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375eca-f446-4ff0-bf83-e43bf3fbc1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:22.410751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375eca-f446-4ff0-bf83-e43bf3fbc1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.412104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3375eca-f446-4ff0-bf83-e43bf3fbc1eb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.425277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 395/806] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:22.426487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d8543-8d9f-4331-be8f-5cdc196fab4f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.426731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d8543-8d9f-4331-be8f-5cdc196fab4f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.427001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d8543-8d9f-4331-be8f-5cdc196fab4f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.428366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 396/807] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:22.428876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d8543-8d9f-4331-be8f-5cdc196fab4f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.496161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.500786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db2468-d88f-46cf-93e6-a74dd22ec7cf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.538531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.539148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.539428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.539681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.540283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.541616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.544036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d8543-8d9f-4331-be8f-5cdc196fab4f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:22.551060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:22.552080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:22.552948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 412/808] 10.222.0.69 () {56 vars in 1129 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:22.553789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.566893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.591847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffbca4-814b-4b22-acee-561045d700e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.592464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffbca4-814b-4b22-acee-561045d700e8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.592739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffbca4-814b-4b22-acee-561045d700e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.593006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffbca4-814b-4b22-acee-561045d700e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.593683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffbca4-814b-4b22-acee-561045d700e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:22.593985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffbca4-814b-4b22-acee-561045d700e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.595340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffbca4-814b-4b22-acee-561045d700e8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.607743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 397/809] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:22.608926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22e034-7291-41b0-8e4c-14c9b0592abc None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.609215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22e034-7291-41b0-8e4c-14c9b0592abc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.609486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22e034-7291-41b0-8e4c-14c9b0592abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.627110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9d22e034-7291-41b0-8e4c-14c9b0592abc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:22.628921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9d22e034-7291-41b0-8e4c-14c9b0592abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:22.676348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993cdfd-2c5b-4fbb-97f1-fa418e4abf1e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.702409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 398/810] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:22.702409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22e034-7291-41b0-8e4c-14c9b0592abc None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.725297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5769401-3256-464c-ac57-493697ba542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.726298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769401-3256-464c-ac57-493697ba542d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.726651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769401-3256-464c-ac57-493697ba542d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.726999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769401-3256-464c-ac57-493697ba542d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.736735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5769401-3256-464c-ac57-493697ba542d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.739574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5769401-3256-464c-ac57-493697ba542d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d5769401-3256-464c-ac57-493697ba542d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:22.754980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:22.756086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:22.757061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:22.758034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 413/811] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:22.758117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.759412 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5769401-3256-464c-ac57-493697ba542d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.818026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22e034-7291-41b0-8e4c-14c9b0592abc None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.844286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.855959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.856991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.857543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.858045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.858982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:22.859533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.861194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.867128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 399/812] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:22.868271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.886666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5769401-3256-464c-ac57-493697ba542d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.932132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.932789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.933098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.933848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.981198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafec4a-c4f4-4fba-a329-633873472ee6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.994579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:23.021973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.022507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.022787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.023056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.023799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:23.024104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.025591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.050094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 400/813] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:23.050094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.068946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.070415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:23.083478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:23.084439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 414/814] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:23.085383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.164798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdb9f-ffb8-4de3-81d7-a4a724d55479 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.190743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efa1b-a514-4790-a14f-bdb0cd32ed79 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.202264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.202862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.203136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.203408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.204025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:23.204319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.205693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.214991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 401/815] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:23.214991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.223325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:23.232615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.233388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.233673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.234024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] PATH_INFO: `/v3/services/network` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.234693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.236120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:23.245791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:23.247033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 04:04:23.248088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:23.248918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 415/816] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:23.249497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.256631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:23.330160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943f494-888f-4d8f-ac0c-277d5b441e1e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.356251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b071a70-0dc6-4367-822f-4e6d1df48255 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.368761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.369367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.369670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.369935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.392474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.393069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.393354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.393654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.394949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:23.395253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.396667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.414228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 416/817] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:23.419206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.443495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.445126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.470460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:23.477390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:23.526492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e99e-f283-4e7d-b90a-1fbc9c4cf3c3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.555986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 402/818] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:23.555986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.568330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.568933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.569203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.569466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.570216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.571553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.600705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 417/819] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:23.601769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.721186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d14501-13c5-440d-818a-c8a866d3a579 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.739421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cadcc6-4883-43c8-b40d-119246516c81 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.742312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:23.762069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:23.768790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.769681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.770032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.770791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.771533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:23.771841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.774150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.779262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 403/820] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:23.780066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.789431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.790129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.790410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.790679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.803251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.804704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:23.823702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:23.824931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:23.826083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:23.826083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:23.826083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:23.829599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 418/821] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:23.832407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:23.893701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a448-0be7-48bc-bfb0-bd46e19d42c6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.931464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:23.932192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.932541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.932882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.949920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:23.951457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:23.968968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198625-daa8-4d2c-b585-78eec8731346 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:23.980522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:23.981743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:23.982863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:23.982863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:23.982863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:23.985436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 404/822] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:23.986463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.015188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.016303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.016303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.016750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.017458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:24.017911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.020007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.025868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 419/823] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:24.026736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.048271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.051573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.114745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388b7df-13a7-414f-94fd-9710915cf991 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.149541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837c8d-1d2f-4f7c-a179-b35eeab98dc9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.162755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.163912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.164882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.165365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.166465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:24.167219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.169142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.185434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc67e5-6f7e-4e5f-a2e6-0c86d9c2ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.190234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc67e5-6f7e-4e5f-a2e6-0c86d9c2ead1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.190234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc67e5-6f7e-4e5f-a2e6-0c86d9c2ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.190234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc67e5-6f7e-4e5f-a2e6-0c86d9c2ead1 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.190234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc67e5-6f7e-4e5f-a2e6-0c86d9c2ead1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:24.190234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc67e5-6f7e-4e5f-a2e6-0c86d9c2ead1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.190234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc67e5-6f7e-4e5f-a2e6-0c86d9c2ead1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.191203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 405/824] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:24.191203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.207814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 420/825] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:24.209089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc5e2-0377-44a2-b84f-25b281986010 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.209368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc5e2-0377-44a2-b84f-25b281986010 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.209670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebc5e2-0377-44a2-b84f-25b281986010 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.214827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 421/826] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:24.214827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebc5e2-0377-44a2-b84f-25b281986010 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.297854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e7a0f-6f53-45e1-8047-9bec0818401c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.302378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.309535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.327094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebc5e2-0377-44a2-b84f-25b281986010 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.337810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.338820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.339394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.339667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.340324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.342686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.362151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349e307-0f9f-46f0-9eba-72bfb60ccca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.363318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e307-0f9f-46f0-9eba-72bfb60ccca3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.363594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e307-0f9f-46f0-9eba-72bfb60ccca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.363862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349e307-0f9f-46f0-9eba-72bfb60ccca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.370432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349e307-0f9f-46f0-9eba-72bfb60ccca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.371871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349e307-0f9f-46f0-9eba-72bfb60ccca3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.373864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 406/827] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:24.375444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b349e307-0f9f-46f0-9eba-72bfb60ccca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:24.384219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:24.385237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:24.386160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:24.389974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 422/828] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:24.391417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa481-d82d-4f08-a1e9-941f0faacbdb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.391704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa481-d82d-4f08-a1e9-941f0faacbdb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.391975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa481-d82d-4f08-a1e9-941f0faacbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.412781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a9aaa481-d82d-4f08-a1e9-941f0faacbdb None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:24.413990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a9aaa481-d82d-4f08-a1e9-941f0faacbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:24.505394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 423/829] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:24.506730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa481-d82d-4f08-a1e9-941f0faacbdb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.521273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab26e6-a8cc-4fb6-84e2-3e8e27d130a4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.567326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.567954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.568222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.568490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.576929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.579162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.587442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:24.601298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:24.602232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:24.603133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 407/830] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:24.613436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.648404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.650187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa481-d82d-4f08-a1e9-941f0faacbdb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.702656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.704291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.704753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.705201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.706094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:24.707354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.711842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.728418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 424/831] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:24.734800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.759800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dac2d-9cc0-4845-8342-534d4a90c77b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.820000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.820764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.821124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.821402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.822155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:24.822458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.823903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.837174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 408/832] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:24.838022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.867365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d757c7-6140-46ff-93ae-7f8ac139739a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.891885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.904066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.904711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.904992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.905263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/0d67ec68dae046f0b5ae1b2c30b04a20/roles/d58aba80ce4142dfade37664a1f81d8f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.920852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=0d67ec68dae046f0b5ae1b2c30b04a20, role_id=d58aba80ce4142dfade37664a1f81d8f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:24.922302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:24.933435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.935234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 425/833] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:24 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/0d67ec68dae046f0b5ae1b2c30b04a20/roles/d58aba80ce4142dfade37664a1f81d8f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:04:24.946498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.953081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c409e9b-3beb-444d-8c09-ede14f57eab5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.994542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.995502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.995988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.996515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.009703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:25.015086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:25.016139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:25.017009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:25.019922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 409/834] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:25.027767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:25.082450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd806bb3-d58b-4536-8507-ab8d230319e0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:25.124854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:25.125486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.125799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.126055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.127433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=c8b82c351b9340ee88bbb4a9b490847f) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:25.127433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:25.128620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:25.135053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 426/835] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/role_assignments?user.id=c8b82c351b9340ee88bbb4a9b490847f&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:25.168338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd223cb-971e-47a1-8c6b-321a90727ab8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:25.207275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:25.208152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.208571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.208982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.209834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:25.210276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:25.211841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:25.226427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 410/836] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:25.229064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:25.277111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:25.345057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb447-ffea-42b6-9cf6-9678c1e317de None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:25.380096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:25.380726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.381001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.381267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.392456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:25.394467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:25.409235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:25.410920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:25.411836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:25.411836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:25.411836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:25.415822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 427/837] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:25.417179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:25.426771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:25.522230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e24b53-17e7-47c2-978e-fc78ea2c26ef None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:25.562673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04d3b5-7225-44e8-83ae-3917cd619bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:25.563637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d3b5-7225-44e8-83ae-3917cd619bee None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.564117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d3b5-7225-44e8-83ae-3917cd619bee None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.564611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04d3b5-7225-44e8-83ae-3917cd619bee None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.565458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04d3b5-7225-44e8-83ae-3917cd619bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:25.566530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04d3b5-7225-44e8-83ae-3917cd619bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:25.568093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04d3b5-7225-44e8-83ae-3917cd619bee None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:25.581990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 411/838] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:25.590059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:25.628009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79b07-6f39-4233-8e26-52658722b153 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.628878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79b07-6f39-4233-8e26-52658722b153 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.629095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79b07-6f39-4233-8e26-52658722b153 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.630739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 412/839] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:25.635722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d938-9beb-49ba-9a76-7baa31461d40 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.635994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d938-9beb-49ba-9a76-7baa31461d40 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.636259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482d938-9beb-49ba-9a76-7baa31461d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.655381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7482d938-9beb-49ba-9a76-7baa31461d40 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:25.656577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7482d938-9beb-49ba-9a76-7baa31461d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:25.688538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:25.701243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75696bd-71ce-4ff5-a421-82cf208c385b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:25.725720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:25.735380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 413/840] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:25.746732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:25.747620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.748041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.748450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.756996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:25.758627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:25.769888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:25.771042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 04:04:25.772089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:25.778455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 428/841] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:25.779933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482d938-9beb-49ba-9a76-7baa31461d40 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:25.882646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482d938-9beb-49ba-9a76-7baa31461d40 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.039782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d788a-3826-4665-896b-b969c181b82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.040799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d788a-3826-4665-896b-b969c181b82a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.041220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d788a-3826-4665-896b-b969c181b82a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.041534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.042214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d788a-3826-4665-896b-b969c181b82a None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.043111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d788a-3826-4665-896b-b969c181b82a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:26.043563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d788a-3826-4665-896b-b969c181b82a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.045246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d788a-3826-4665-896b-b969c181b82a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.071207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 414/842] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 30 04:04:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:26.072637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d788a-3826-4665-896b-b969c181b82a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.134524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:26.147487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c2171-ee02-44c1-9c29-7a7b86a761ac None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.182006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.182675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.182950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.183267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.183845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.184824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d788a-3826-4665-896b-b969c181b82a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.185185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:26.195369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:26.196617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:26.197719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:26.201144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 429/843] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:26.202156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.219424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:26.227337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.228174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.228622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.229064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.306887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.308819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.312426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf71a-9b6f-42c4-aa85-98e949ecd130 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.351736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.352333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.352608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.352877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.353520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:26.353830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.355178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.365461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 430/844] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:26.366398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.374812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:26.429098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 415/845] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:04:26.430671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.451950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:26.475571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b3944-cee0-463f-a4f3-52581dff4ee5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.512344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.512755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.513032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.513297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.513950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:26.514247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.515693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.529548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 431/846] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:26.541620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e67c-aa32-4a59-8549-ac8fdd3c70a3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.580992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.593055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.593055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.593055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.605209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.606706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:26.623817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:26.624832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:26.626010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:26.626010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:26.626010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:26.626010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 416/847] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:26.632369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.745946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53042360-7daa-4d38-9f5c-26718593352a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.782897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6484e0-db27-476f-870c-81cd878435c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.783492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6484e0-db27-476f-870c-81cd878435c8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.783767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6484e0-db27-476f-870c-81cd878435c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.784032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6484e0-db27-476f-870c-81cd878435c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.785287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6484e0-db27-476f-870c-81cd878435c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:26.785616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6484e0-db27-476f-870c-81cd878435c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.787011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6484e0-db27-476f-870c-81cd878435c8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.799090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 432/848] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:26.804779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.814533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:26.911468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc73c6-e416-4ccc-89cd-d6d9bb8fd28c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:26.946784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:26.947799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.948306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.948817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.956171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:26.958508 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:26.971180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:26.972676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:26.973704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:26.978603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 417/849] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:26.980329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6629-abd9-4d4d-9348-a03897388519 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.980611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6629-abd9-4d4d-9348-a03897388519 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.980879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6629-abd9-4d4d-9348-a03897388519 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.982436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 433/850] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:26.982922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:26.988460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c394f-52a3-4bfa-85e4-7a392ce27cf4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:26.988740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c394f-52a3-4bfa-85e4-7a392ce27cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:26.989009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c394f-52a3-4bfa-85e4-7a392ce27cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:26.997961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:27.008698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b65c394f-52a3-4bfa-85e4-7a392ce27cf4 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:27.010197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b65c394f-52a3-4bfa-85e4-7a392ce27cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:27.075152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:27.113837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 434/851] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:27.117981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe768-4d3a-409e-932a-c7a60a663205 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:27.154093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c34b8f-417a-4769-b159-5e59647ba56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:27.155090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c34b8f-417a-4769-b159-5e59647ba56f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.155625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c34b8f-417a-4769-b159-5e59647ba56f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.156145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c34b8f-417a-4769-b159-5e59647ba56f None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.157074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c34b8f-417a-4769-b159-5e59647ba56f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:27.157593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c34b8f-417a-4769-b159-5e59647ba56f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:27.159215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c34b8f-417a-4769-b159-5e59647ba56f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:27.177328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 418/852] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:27.178997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c394f-52a3-4bfa-85e4-7a392ce27cf4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:27.249022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23dbd9-14bf-4ccb-a5ed-f8e57b90fcda None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.249364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23dbd9-14bf-4ccb-a5ed-f8e57b90fcda None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.250663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23dbd9-14bf-4ccb-a5ed-f8e57b90fcda None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.251184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 419/853] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:27.258381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213be2-7ade-4d4a-8c64-afda9298f61b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.258898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213be2-7ade-4d4a-8c64-afda9298f61b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.259363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213be2-7ade-4d4a-8c64-afda9298f61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.278233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c3213be2-7ade-4d4a-8c64-afda9298f61b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:27.279700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c3213be2-7ade-4d4a-8c64-afda9298f61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:27.293086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c394f-52a3-4bfa-85e4-7a392ce27cf4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:27.332139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:27.341556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:27.342418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.342684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.342953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.343848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=16ba94b3c081488a851579dc5883427b) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:27.344146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:27.346229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:27.357852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 420/855] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:27.358040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 435/855] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:27 2022] GET /identity/v3/role_assignments?user.id=16ba94b3c081488a851579dc5883427b&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:27.377272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:27.487514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf86cb-170e-402b-8fb1-31c90540a9da None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:27.528916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:27.529569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.529844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.530115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.540805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:27.546175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:27.547111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:27.547955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 436/856] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:04:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:27.555178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213be2-7ade-4d4a-8c64-afda9298f61b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:27.620579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:27.626599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:27.669103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213be2-7ade-4d4a-8c64-afda9298f61b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:27.703085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:27.709795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:27.710738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.711513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.712187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.713023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:27.713468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:27.715136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:27.727729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 421/857] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:04:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:27.732728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:27.761666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e30315-c9c7-4022-8da4-3378ca4d549f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:27.807453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:27.808316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.808598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.808868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.809439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:27.811472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:27.823930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:27.824919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:27.826257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:27.829581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 437/858] 10.222.0.69 () {56 vars in 1132 bytes} [Tue Aug 30 04:04:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:27.830945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:27.877128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9749-51cd-4d07-8e9f-4bef722e9613 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:27.901309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:27.925411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:27.926249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.926523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.926787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.939346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:27.941360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:27.959295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:27.960324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:27.961250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:27.961250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:27.961250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:27.961250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 422/859] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:27.967323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:27.971413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a7fe-1ac1-46c8-9b6d-a53d2e7c50e9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:27.994288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.010376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:28.011345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.011876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.012401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.013226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:28.013757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:28.015296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:28.020574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 438/860] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:28.026366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:28.078700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a5246-624c-4188-a4f7-aa6e85c06cb4 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:28.114743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:28.115405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.115666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.115938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.116571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:28.116865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:28.118258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:28.135489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 423/861] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:28.136505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:28.140858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10d786-027b-47fa-b85c-3c92a1fd9a29 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:28.176787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.188364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:28.188965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.189238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.189501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:28.190444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:28.192419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:28.205546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 439/862] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:28.265946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530227f1-fb12-4887-a2ef-627b12c177a7 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:28.305052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:28.305724 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.306001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.306270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.314610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:28.316125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:28.329085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:28.330146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:28.331118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 424/863] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:04:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:28.342860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:28.398042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.451115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb897aa-ecb5-4db3-9164-56bb5ae6e3ec None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:28.487512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a5bd-e92c-4e97-882c-694437396db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:28.488177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a5bd-e92c-4e97-882c-694437396db9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.488433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a5bd-e92c-4e97-882c-694437396db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.488674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a5bd-e92c-4e97-882c-694437396db9 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.489395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a5bd-e92c-4e97-882c-694437396db9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:28.489722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a5bd-e92c-4e97-882c-694437396db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:28.491121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a5bd-e92c-4e97-882c-694437396db9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:28.509075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 440/864] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 30 04:04:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:28.515014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:28.520421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b273-bd18-46ba-8f12-347d13671380 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.521003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b273-bd18-46ba-8f12-347d13671380 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.521473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b273-bd18-46ba-8f12-347d13671380 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.523449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 441/865] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:28.528779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969746-8417-4416-bb6b-2191a546b1b3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.529055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969746-8417-4416-bb6b-2191a546b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.529325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d969746-8417-4416-bb6b-2191a546b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.549385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7d969746-8417-4416-bb6b-2191a546b1b3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:28.551153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7d969746-8417-4416-bb6b-2191a546b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:28.627066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.641116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 442/866] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:28.643627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c044-bfdd-48d3-bf88-9b00567159ad None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:28.683366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:28.684402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.684930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.685402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.765355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:28.767089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:28.860562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.878178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d969746-8417-4416-bb6b-2191a546b1b3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:28.881329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 425/867] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:28.916352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.933939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:28.992871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d969746-8417-4416-bb6b-2191a546b1b3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:29.030839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:29.031853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.032368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.032780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.038365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083c4e-01fd-407d-bdc4-b8c832c98bcd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:29.044240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:29.046054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:29.062527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:29.063703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:29.064817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:29.064817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:29.064817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:29.067353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 443/868] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:29.072805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:29.081399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:29.082101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.082377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.082689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.083358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:29.084716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:29.113648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 426/869] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:28 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:29.184528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:29.200881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b41f49-680a-453d-82ca-1492038b76d2 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:29.246722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f48315-e3ca-409a-a1ed-1edf301500cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:29.246932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48315-e3ca-409a-a1ed-1edf301500cf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.247265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48315-e3ca-409a-a1ed-1edf301500cf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.247537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f48315-e3ca-409a-a1ed-1edf301500cf None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.248214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f48315-e3ca-409a-a1ed-1edf301500cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:29.248516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f48315-e3ca-409a-a1ed-1edf301500cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:29.249970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f48315-e3ca-409a-a1ed-1edf301500cf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:29.263509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 444/870] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:29.269907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:29.323380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:29.352809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5255e-67c2-4278-81e0-65e05b6cc992 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.353158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5255e-67c2-4278-81e0-65e05b6cc992 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.353348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5255e-67c2-4278-81e0-65e05b6cc992 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.354954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 445/871] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:29.359714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a919df-893c-4a69-bbe7-ffcef2b01c92 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.359992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a919df-893c-4a69-bbe7-ffcef2b01c92 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.360260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a919df-893c-4a69-bbe7-ffcef2b01c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.380318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-85a919df-893c-4a69-bbe7-ffcef2b01c92 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:29.381418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-85a919df-893c-4a69-bbe7-ffcef2b01c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:29.385189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5ae3-21c1-4299-b0de-c35fe2637a94 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:29.423696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:29.424699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.426166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.426636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.435827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:29.437810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:29.452570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:29.453479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:29.454484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:29.454909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 446/872] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:29.454983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 427/873] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:29.460677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a919df-893c-4a69-bbe7-ffcef2b01c92 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:29.538235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:29.564346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a919df-893c-4a69-bbe7-ffcef2b01c92 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:29.612195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:29.612821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.613714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.613981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.614668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:29.614966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:29.616373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:29.628607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 447/874] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:29.634730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:29.753840 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584c67c-3cd6-4d72-9c1c-234ffbbf55e6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:29.767904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:29.774044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:29.802619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:29.803172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.803450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.803716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.804601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=0d67ec68dae046f0b5ae1b2c30b04a20) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:29.804796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:29.806201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:29.812511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 428/875] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:29 2022] GET /identity/v3/role_assignments?user.id=0d67ec68dae046f0b5ae1b2c30b04a20&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:29.889212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fad4c-90e4-4f67-802e-c62c6ca2bdab None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:29.927605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:29.928538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:29.929040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:29.929454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:29.930194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:29.931705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:29.933984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:29.942425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:29.944303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:29.945433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 448/876] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:29.950609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:30.063026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d6bb3-2a73-428e-a353-5302e7746755 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:30.098597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30719813-4a14-4bd3-bd7a-77061531fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:30.099205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30719813-4a14-4bd3-bd7a-77061531fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:30.099474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30719813-4a14-4bd3-bd7a-77061531fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:30.099736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30719813-4a14-4bd3-bd7a-77061531fbb8 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:30.100366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30719813-4a14-4bd3-bd7a-77061531fbb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:30.100723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30719813-4a14-4bd3-bd7a-77061531fbb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:30.102280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30719813-4a14-4bd3-bd7a-77061531fbb8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:30.107267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 429/877] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:30.112920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:30.192003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c474-0aaf-4f52-9735-d50a40add4e9 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:30.192177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c474-0aaf-4f52-9735-d50a40add4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:30.192447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c474-0aaf-4f52-9735-d50a40add4e9 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:30.194084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 430/878] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:30.199108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be304-6ca9-4760-92ae-6531aae6fd5f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:30.199388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be304-6ca9-4760-92ae-6531aae6fd5f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:30.199663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be304-6ca9-4760-92ae-6531aae6fd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:30.218916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a15be304-6ca9-4760-92ae-6531aae6fd5f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:30.219327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249369-60a7-453e-9d06-a18752b86831 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:30.220123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a15be304-6ca9-4760-92ae-6531aae6fd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:30.256639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:30.259207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:30.259751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:30.260022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:30.260287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:30.261548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:30.261854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:30.264776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:30.273604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 449/879] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:30.307434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 431/880] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:30.579581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:30.645406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:30.686169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95593-b60c-498b-9be5-b0c09a812eb8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:30.721422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826ab62-d6a4-4c2d-b751-ebb06022d35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:30.722053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ab62-d6a4-4c2d-b751-ebb06022d35a None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:30.722362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ab62-d6a4-4c2d-b751-ebb06022d35a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:30.722671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ab62-d6a4-4c2d-b751-ebb06022d35a None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:30.723266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826ab62-d6a4-4c2d-b751-ebb06022d35a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:30.724605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826ab62-d6a4-4c2d-b751-ebb06022d35a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:30.743437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 450/881] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:30 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:31.182564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209df0-30d2-4948-9bbb-ead23bcd9974 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:31.183614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209df0-30d2-4948-9bbb-ead23bcd9974 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:31.184088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209df0-30d2-4948-9bbb-ead23bcd9974 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:31.185906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 432/882] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:31.191206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df76878-1e33-42c1-ad35-775ad7c74270 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:31.191712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df76878-1e33-42c1-ad35-775ad7c74270 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:31.192191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df76878-1e33-42c1-ad35-775ad7c74270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:31.210646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2df76878-1e33-42c1-ad35-775ad7c74270 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:31.212115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2df76878-1e33-42c1-ad35-775ad7c74270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:31.288932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 451/883] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:31.554409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209df0-30d2-4948-9bbb-ead23bcd9974 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:31.676973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209df0-30d2-4948-9bbb-ead23bcd9974 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:31.713124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b90744-a4d6-452f-bfc3-488b85eeca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:31.713791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b90744-a4d6-452f-bfc3-488b85eeca24 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:31.714073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b90744-a4d6-452f-bfc3-488b85eeca24 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:31.714342 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b90744-a4d6-452f-bfc3-488b85eeca24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:31.714921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b90744-a4d6-452f-bfc3-488b85eeca24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:31.716284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b90744-a4d6-452f-bfc3-488b85eeca24 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-30b90744-a4d6-452f-bfc3-488b85eeca24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:31.726287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:31.727310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:31.728550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 433/884] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:31.735663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df76878-1e33-42c1-ad35-775ad7c74270 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:31.787070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:31.844235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df76878-1e33-42c1-ad35-775ad7c74270 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:31.877483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14e7a-0c58-453e-8173-e7238e3cb64e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:31.877854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14e7a-0c58-453e-8173-e7238e3cb64e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:31.878054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14e7a-0c58-453e-8173-e7238e3cb64e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:31.879676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 434/885] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:31.883535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:31.884154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:31.884429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:31.884698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:31.885334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:31.885664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:31.885866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d02994-ccf5-4af2-9a18-6b6caba80138 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:31.886058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d02994-ccf5-4af2-9a18-6b6caba80138 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:31.886335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d02994-ccf5-4af2-9a18-6b6caba80138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:31.887034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:31.892671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 452/886] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:31.901313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:31.907490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-03d02994-ccf5-4af2-9a18-6b6caba80138 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:31.908675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-03d02994-ccf5-4af2-9a18-6b6caba80138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:31.949920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:32.002693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 435/887] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:32.020671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c99d77-fff0-4e9d-b80c-bfe3ace5317d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:32.046798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:32.057891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:32.058788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.059110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.059382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.060005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:32.060306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:32.061843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:32.067709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 453/888] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:32.074870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d02994-ccf5-4af2-9a18-6b6caba80138 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:32.177092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d02994-ccf5-4af2-9a18-6b6caba80138 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:32.211663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf0434-980b-4d62-b3c0-7d3b925872fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:32.213046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf0434-980b-4d62-b3c0-7d3b925872fa None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.213573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf0434-980b-4d62-b3c0-7d3b925872fa None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.214087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf0434-980b-4d62-b3c0-7d3b925872fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.215047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf0434-980b-4d62-b3c0-7d3b925872fa None admin] RBAC: Adding query filter params (interface=public, service_id=17e471ae7fda419480f4d4ca6d67c05b, region_id=RegionOne) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:32.215543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf0434-980b-4d62-b3c0-7d3b925872fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:32.217344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf0434-980b-4d62-b3c0-7d3b925872fa None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:32.227350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 436/889] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:04:32 2022] GET /identity/v3/endpoints?service_id=17e471ae7fda419480f4d4ca6d67c05b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:32.230603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:32.251151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c081ff-5d2b-4f08-a62e-d3cb689e47dc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.251478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c081ff-5d2b-4f08-a62e-d3cb689e47dc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.251697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c081ff-5d2b-4f08-a62e-d3cb689e47dc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.253286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 437/890] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:32.258844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f210c-2f4c-401a-a454-b55a7e1ff250 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.259124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f210c-2f4c-401a-a454-b55a7e1ff250 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.259397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f210c-2f4c-401a-a454-b55a7e1ff250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.280626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-838f210c-2f4c-401a-a454-b55a7e1ff250 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:32.281849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-838f210c-2f4c-401a-a454-b55a7e1ff250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:32.304819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:32.352626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4bedb-2022-4d2d-9a01-289fef510474 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:32.361971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 438/891] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:32.361971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f210c-2f4c-401a-a454-b55a7e1ff250 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:32.394394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:32.395460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.395827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.396343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.397099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:32.398986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:32.409677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 454/892] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:32 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:04:32.485677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f210c-2f4c-401a-a454-b55a7e1ff250 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:32.534612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:32.535290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.535560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.535883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.547793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:32.554521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:32.555544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:32.556406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 439/893] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 30 04:04:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:32.563336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:32.612729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:32.629399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:32.649343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:32.684658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddebeab-f8fe-4b3c-bb80-dbf0399983ae None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:32.738456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:32.738969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.739246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.739532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.743825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:32.745553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:32.747005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:32.765942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 455/894] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 30 04:04:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:32.773344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09014c2-c9a1-4411-b159-9e6bf660c4e5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:32.774977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:32.811261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de9cc1-f95a-4188-8ef7-92ed39648fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:32.811853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9cc1-f95a-4188-8ef7-92ed39648fe6 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.812140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9cc1-f95a-4188-8ef7-92ed39648fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.812405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de9cc1-f95a-4188-8ef7-92ed39648fe6 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.813064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de9cc1-f95a-4188-8ef7-92ed39648fe6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:32.814453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de9cc1-f95a-4188-8ef7-92ed39648fe6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:32.831128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 440/895] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:32 2022] POST /identity/v3/services => generated 241 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:04:32.832247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd159d-1c43-484a-8b6e-18d8f4ac4a72 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.832532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd159d-1c43-484a-8b6e-18d8f4ac4a72 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.832806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd159d-1c43-484a-8b6e-18d8f4ac4a72 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.834257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 441/896] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:32.839758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78aec-f0a3-4ee5-ac52-c24927b039e5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.840090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78aec-f0a3-4ee5-ac52-c24927b039e5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.840307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b78aec-f0a3-4ee5-ac52-c24927b039e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.871286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-96b78aec-f0a3-4ee5-ac52-c24927b039e5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:32.872873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-96b78aec-f0a3-4ee5-ac52-c24927b039e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:32.896654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1ee05-35dd-4ee2-86fc-1bec72beb703 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:32.898853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:32.944152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:32.944956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:32.945364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:32.945918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:32.958515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:32.960187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:32.974599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 442/897] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:32.980038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:32.980984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:32.981896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:32.981896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:32.981896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:32.983707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 456/898] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:32.991423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b78aec-f0a3-4ee5-ac52-c24927b039e5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:32.999296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.102102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b78aec-f0a3-4ee5-ac52-c24927b039e5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.137387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.138020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.138292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.138556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.139192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:33.139485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:33.140837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:33.153092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 443/899] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:33.158777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.263080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3897-3e27-49d6-b926-c0595298a047 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.265864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.296737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.297363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.297670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.297946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.306272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:33.307687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:33.324649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:33.325751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:33.326694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 457/900] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:33.332513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.348808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.358146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.389668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f162ad-e84a-4fde-9292-6103f4f2a46c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.429879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.430983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.431533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.432036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.432822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:33.434511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:33.444618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75db9e7-b06b-4fc3-b79b-78ac56ee8b71 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:33.446478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:33.447391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:33.448276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:33.452628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 444/901] 10.222.0.69 () {56 vars in 1132 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:33.462089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.487755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.488430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.488749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.489023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.489783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:33.490081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:33.491552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:33.511346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 458/902] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:33.516513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.593946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.602273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894431fa-7ec5-434a-8f36-c033773a1e5a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.633540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.640343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.640952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.641266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.641598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.641807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0645a-b401-4989-abd0-4d90e707b668 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.642230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:33.642578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:33.644125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:33.655930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 445/903] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:33.656982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.687888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.689127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.689651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.690395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.777821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df5b31-0b30-4e1b-b9e5-8b7e2b741338 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.784207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:33.786568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:33.824573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.825185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.825526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.825808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.826494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:33.826742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:33.828159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:33.839556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 446/904] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:33.840841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.882113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.917422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 459/905] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:04:33.917746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:33.922562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:33.962124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39c9e-c579-48ce-b514-ca480d8d1a2c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:33.998279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:33.999011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.999572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.999572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.000442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] RBAC: Adding query filter params (interface=public, service_id=f92940280db4437dbf7c72e8dd11eb36, region_id=RegionOne) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:34.000898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:34.002333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:34.013793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 447/906] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/endpoints?service_id=f92940280db4437dbf7c72e8dd11eb36&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:34.014762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:34.049443 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4d367-0eb0-42d7-b954-473a8dca0a8a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:34.087018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:34.088036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.088503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.089015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.100048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:34.102016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:34.119400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:34.120403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:34.121295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:34.121295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:34.121295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:34.122499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adb2a-fb47-440f-8ee2-de532b8b6d82 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:34.123688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 460/907] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:34.133098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:34.153885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.155451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.163854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:34.164596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.164883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.165162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.165795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:34.167220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:34.181845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 448/908] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:34 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:04:34.240764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ebb1e-3a6a-48a5-813a-0f1ddd0c1229 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:34.284037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:34.285220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.285681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.286099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.286915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:34.287382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:34.288916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:34.303596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 461/909] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:34.308950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:34.415306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357696-1cef-4094-96b3-01d6ccf531e0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:34.450007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067481b-979a-4400-bfe0-539868138fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:34.450637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067481b-979a-4400-bfe0-539868138fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.450911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067481b-979a-4400-bfe0-539868138fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.451179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067481b-979a-4400-bfe0-539868138fc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.458210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067481b-979a-4400-bfe0-539868138fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:34.459712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067481b-979a-4400-bfe0-539868138fc1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6067481b-979a-4400-bfe0-539868138fc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:34.471594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:34.472561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:34.473460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 449/910] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:34.480232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:34.567167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261593-642c-4ca4-9d9f-a981de3eca56 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.567460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261593-642c-4ca4-9d9f-a981de3eca56 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.567629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261593-642c-4ca4-9d9f-a981de3eca56 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.569211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 450/911] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:34.569743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.574369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b72af-d3a0-4b12-bda3-bb5a2f2de812 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.574653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b72af-d3a0-4b12-bda3-bb5a2f2de812 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.574929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b72af-d3a0-4b12-bda3-bb5a2f2de812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.589855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2bdf-90bd-4b1c-b08c-0c33f04b3eef None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:34.608383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-398b72af-d3a0-4b12-bda3-bb5a2f2de812 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:34.610027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-398b72af-d3a0-4b12-bda3-bb5a2f2de812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:34.625533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:34.626140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.626416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.626746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.627435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:34.627738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:34.629715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:34.646949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 462/912] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:34.648318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:34.666343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.705534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 451/913] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:34.764927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf433-97c0-412d-9bfd-c008ffd408ec None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:34.807075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aed8cf-590b-43fa-98cd-c772b3691c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:34.807676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aed8cf-590b-43fa-98cd-c772b3691c26 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.807950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aed8cf-590b-43fa-98cd-c772b3691c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.808221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aed8cf-590b-43fa-98cd-c772b3691c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.808939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aed8cf-590b-43fa-98cd-c772b3691c26 None admin] RBAC: Adding query filter params (role.id=253befad441c45648ded1351b0fda915, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=0d67ec68dae046f0b5ae1b2c30b04a20) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:34.809240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aed8cf-590b-43fa-98cd-c772b3691c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:34.810692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aed8cf-590b-43fa-98cd-c772b3691c26 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:34.816775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 463/914] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:34 2022] GET /identity/v3/role_assignments?user.id=0d67ec68dae046f0b5ae1b2c30b04a20&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=253befad441c45648ded1351b0fda915 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:34.869857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad6e8-ae59-47eb-b64a-41c4e0b77d4a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.870195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad6e8-ae59-47eb-b64a-41c4e0b77d4a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.870400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad6e8-ae59-47eb-b64a-41c4e0b77d4a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.872051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 452/915] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:34.877656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a49bc-9b48-4a7d-ac4b-1e372f83e818 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.877943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a49bc-9b48-4a7d-ac4b-1e372f83e818 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.878219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a49bc-9b48-4a7d-ac4b-1e372f83e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.886837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.899243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-969a49bc-9b48-4a7d-ac4b-1e372f83e818 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:34.900453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-969a49bc-9b48-4a7d-ac4b-1e372f83e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:34.973785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 464/916] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:34.997717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ad6e8-ae59-47eb-b64a-41c4e0b77d4a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.102123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ad6e8-ae59-47eb-b64a-41c4e0b77d4a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.138221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:35.138763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:35.139034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:35.139298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:35.139867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.141214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:35.150039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:35.151523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:35.152415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 453/917] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:35.157708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a49bc-9b48-4a7d-ac4b-1e372f83e818 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.262983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a49bc-9b48-4a7d-ac4b-1e372f83e818 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.269590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.309748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:35.310404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:35.310961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:35.311234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:35.312755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:35.313060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.314504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.315584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:35.320673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:35.323373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 465/918] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:35.329143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.402199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2eb1e-2c88-4330-9f0d-a19447eb9b70 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.447173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:35.448130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:35.448409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:35.448681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:35.449537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.451631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.459295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162caedd-2a94-4ce5-bbd9-d6f4de9b6363 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:35.464108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:35.465076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:35.466283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 454/919] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:35.472822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.500026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:35.500636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:35.500882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:35.501149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:35.501813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:35.502220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.503558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.509424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 466/920] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 30 04:04:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:35.514803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.579702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:35.618188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d166b-bf76-4c6e-a45b-946e76d29aa3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.621997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:35.630582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce7544-1dd2-44bf-b68f-49c81f37d315 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.657323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:35.657878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:35.658347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:35.658623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:35.659247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:35.659544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.661001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.669932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 455/921] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:35.672044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.677497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:35.678398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:35.678873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:35.679339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:35.680197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.681771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.717801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 467/922] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:04:35.800046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fbaf-3cf5-423e-bf39-05030385ef15 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.843876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:35.844502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:35.844777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:35.845044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:35.845799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:35.846100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.848177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.854156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 456/923] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:35.860154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:35.974215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de41e4-cd2a-40f2-8ada-fb2def52c070 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:35.992015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:36.010475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c03ce2-3c01-4bc4-943c-87300e6454f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:36.011076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c03ce2-3c01-4bc4-943c-87300e6454f0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.011352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c03ce2-3c01-4bc4-943c-87300e6454f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.011618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c03ce2-3c01-4bc4-943c-87300e6454f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.012311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c03ce2-3c01-4bc4-943c-87300e6454f0 None admin] RBAC: Adding query filter params (interface=public, service_id=022a042bf044454ea70bf9b1a3955795, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:36.012613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c03ce2-3c01-4bc4-943c-87300e6454f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:36.013986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c03ce2-3c01-4bc4-943c-87300e6454f0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:36.019918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 468/924] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:04:35 2022] GET /identity/v3/endpoints?service_id=022a042bf044454ea70bf9b1a3955795&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:36.025565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:36.054758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:36.132518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a33b57-f866-49cc-a96b-f8b295510ec2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:36.167779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674858b-44bf-4244-9c00-79b9bb04c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:36.168757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674858b-44bf-4244-9c00-79b9bb04c511 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.169245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674858b-44bf-4244-9c00-79b9bb04c511 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.169733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674858b-44bf-4244-9c00-79b9bb04c511 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.170521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674858b-44bf-4244-9c00-79b9bb04c511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:36.172050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674858b-44bf-4244-9c00-79b9bb04c511 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:36.178964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 457/925] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:36 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:04:36.223853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cbf9-cc84-4cc8-9f5f-396d5994cd63 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.224192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cbf9-cc84-4cc8-9f5f-396d5994cd63 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.224456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cbf9-cc84-4cc8-9f5f-396d5994cd63 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.226169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 469/926] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:36.231940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1175f5d-fb11-48c5-83b1-3aa6e3095845 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.232300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1175f5d-fb11-48c5-83b1-3aa6e3095845 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.232497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1175f5d-fb11-48c5-83b1-3aa6e3095845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.252863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e1175f5d-fb11-48c5-83b1-3aa6e3095845 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:36.254176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e1175f5d-fb11-48c5-83b1-3aa6e3095845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:36.334088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 458/927] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:36.615368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57cbf9-cc84-4cc8-9f5f-396d5994cd63 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:36.720031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57cbf9-cc84-4cc8-9f5f-396d5994cd63 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:36.755209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292990a-281e-4a96-9056-bc3921c1f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:36.755833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292990a-281e-4a96-9056-bc3921c1f5de None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.756110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292990a-281e-4a96-9056-bc3921c1f5de None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.756380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292990a-281e-4a96-9056-bc3921c1f5de None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.756958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292990a-281e-4a96-9056-bc3921c1f5de None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:36.758337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292990a-281e-4a96-9056-bc3921c1f5de None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8292990a-281e-4a96-9056-bc3921c1f5de None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:36.767392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:36.768319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:36.769653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 470/928] 10.222.0.69 () {56 vars in 1132 bytes} [Tue Aug 30 04:04:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:36.774777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1175f5d-fb11-48c5-83b1-3aa6e3095845 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:36.785550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412817f-d69d-46b1-b82e-a6bdbed8c8b4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.787591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412817f-d69d-46b1-b82e-a6bdbed8c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.787866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412817f-d69d-46b1-b82e-a6bdbed8c8b4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.789309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 471/929] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:36.794710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477791fe-86fb-4691-b27e-c2922abda3b0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.795230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477791fe-86fb-4691-b27e-c2922abda3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.795695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477791fe-86fb-4691-b27e-c2922abda3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.805408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:36.817642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-477791fe-86fb-4691-b27e-c2922abda3b0 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:36.819388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-477791fe-86fb-4691-b27e-c2922abda3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:36.880015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:36.906203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1175f5d-fb11-48c5-83b1-3aa6e3095845 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:36.916744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 472/930] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:36.946073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:36.947006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:36.947432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:36.947851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:36.948725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:36.949256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:36.950909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:36.957152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 459/931] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:36.963147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477791fe-86fb-4691-b27e-c2922abda3b0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:37.069575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477791fe-86fb-4691-b27e-c2922abda3b0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:37.104571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:37.105168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.105440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.105745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.106368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:37.106662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:37.108001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:37.113209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 473/932] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:37.119317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:37.206769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:37.222767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5192-642b-4176-8ec1-7d350bf3aa96 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:37.239437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:37.260948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:37.261579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.261855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.262126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.262796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:37.264245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:37.286087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:37.287429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 460/933] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:37.357242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6265d6-fe35-4f92-a3f5-5dce98f1ffa7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:37.405302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:37.405979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.406253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.406518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.418453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:37.423409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:37.424452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:37.425388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 474/934] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 30 04:04:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:37.432569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:37.542207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f4ed-8886-4755-9430-4e5a51529472 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:37.579358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:37.579358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.579358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.579358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.579869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:37.579869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:37.580921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:37.598050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 461/935] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 30 04:04:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:37.603765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:37.704667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:37.710722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f781107-3077-4965-bfae-2aceb3711eac None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:37.747872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1287-0fa1-40a1-a7d3-d98b2a203ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:37.748506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1287-0fa1-40a1-a7d3-d98b2a203ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.748782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1287-0fa1-40a1-a7d3-d98b2a203ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.749052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1287-0fa1-40a1-a7d3-d98b2a203ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.759658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a1287-0fa1-40a1-a7d3-d98b2a203ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:37.761092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a1287-0fa1-40a1-a7d3-d98b2a203ac5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d09a1287-0fa1-40a1-a7d3-d98b2a203ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:37.777367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:37.778424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:37.779335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:37.779335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:37.779335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:37.779335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 475/936] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:37.784710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:37.789221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:37.798521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ed319-ea6d-4242-ad03-c62ae67ae7be None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.798792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ed319-ea6d-4242-ad03-c62ae67ae7be None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.798988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ed319-ea6d-4242-ad03-c62ae67ae7be None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.800580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 476/937] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:37.806153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd91c-b76c-4308-860e-eeffb61f9ae7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.806434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd91c-b76c-4308-860e-eeffb61f9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.806707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd91c-b76c-4308-860e-eeffb61f9ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.824846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-de3fd91c-b76c-4308-860e-eeffb61f9ae7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:37.826076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-de3fd91c-b76c-4308-860e-eeffb61f9ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:37.901791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 477/938] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:37.913356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79fed-9a59-493d-b4d3-c7c4f630be18 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:37.949225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:37.949942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.950223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.950497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.951142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:37.951440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:37.952798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:37.965888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 462/939] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:37.971698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fd91c-b76c-4308-860e-eeffb61f9ae7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.052847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.074603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fd91c-b76c-4308-860e-eeffb61f9ae7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.110105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf17835-e5bf-4c51-a32e-977abbd4bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.110730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17835-e5bf-4c51-a32e-977abbd4bda6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.111004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17835-e5bf-4c51-a32e-977abbd4bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.111274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf17835-e5bf-4c51-a32e-977abbd4bda6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.118400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf17835-e5bf-4c51-a32e-977abbd4bda6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.119826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf17835-e5bf-4c51-a32e-977abbd4bda6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8cf17835-e5bf-4c51-a32e-977abbd4bda6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:38.131704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:38.133902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.136219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 478/940] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:04:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:38.139845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.174932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd58d8-9c68-46db-8a6f-177bf6a740ea None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.175244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd58d8-9c68-46db-8a6f-177bf6a740ea None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.175470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd58d8-9c68-46db-8a6f-177bf6a740ea None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.177241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 479/941] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:38.177954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd58d8-9c68-46db-8a6f-177bf6a740ea None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.210813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.259098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5de23-d5e8-4a6d-bd1b-8502f14b2a57 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.282195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd58d8-9c68-46db-8a6f-177bf6a740ea None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.301188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48675-3daa-4846-8012-324bb825a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.301833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48675-3daa-4846-8012-324bb825a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.302111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48675-3daa-4846-8012-324bb825a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.302381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48675-3daa-4846-8012-324bb825a5c3 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.303162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48675-3daa-4846-8012-324bb825a5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:38.303409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48675-3daa-4846-8012-324bb825a5c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.305259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48675-3daa-4846-8012-324bb825a5c3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.320430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.321033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.321359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.321703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.322341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.323007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 463/942] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:38.323854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.324054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba1abc-6a89-4f67-89c7-a54a000f220b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.324338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba1abc-6a89-4f67-89c7-a54a000f220b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.324608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba1abc-6a89-4f67-89c7-a54a000f220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.327261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING keystone.server.flask.common [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 04:04:38.340715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.342668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e4ba1abc-6a89-4f67-89c7-a54a000f220b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:38.343862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e4ba1abc-6a89-4f67-89c7-a54a000f220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:38.352641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.sql.core [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:04:38.352641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:04:38.352641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [parameters: {'id': '6b6490d7523044cf8a285ecac9577fd6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:04:38.352641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81656) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b6490d7523044cf8a285ecac9577fd6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b6490d7523044cf8a285ecac9577fd6. Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:04:38.375072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result.read() Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 04:04:38.376133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application yield resource Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise self.value Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application session.commit() Aug 30 04:04:38.377595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:04:38.378677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:04:38.380152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application result.read() Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:04:38.380983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [parameters: {'id': '6b6490d7523044cf8a285ecac9577fd6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.382821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:38.384476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b6490d7523044cf8a285ecac9577fd6. Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 480/943] 10.222.0.69 () {60 vars in 1140 bytes} [Tue Aug 30 04:04:38 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:38.387656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.420179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 464/944] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:38.421033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba1abc-6a89-4f67-89c7-a54a000f220b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.494500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.522655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016b6b-cfc1-48ef-a1dc-349ee2316901 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.547895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba1abc-6a89-4f67-89c7-a54a000f220b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.569886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.571084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.571568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.572311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.589634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.591723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.592589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.593240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.593539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.593828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.601753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.603393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:38.610325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:38.611260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:38.612168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:38.612168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:38.612168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:38.618467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:38.619408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:38.620307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 465/945] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:38.620813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 481/946] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:38.620890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.622910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.689382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.731990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b26f8-58f4-451f-a22b-8c80d7446a3d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.746977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.747930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e299675-9b92-4a81-aadc-504678078223 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.771556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.772463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.772933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.773414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.774501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:38.774878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.776244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.781942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.782538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.782811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.783077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.783732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:38.784029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.785452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.794302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 466/947] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:38.794302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.805642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 482/948] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:38.814750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:38.915146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613bf1b-89b5-4ea5-800a-edd96ee4c104 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.962582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.963221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.963499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.963767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.964521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.966602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.969021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7687c-c9a3-466b-b8d9-0f76ac98d4e3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.976858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:38.977736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:38.978741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:38.979589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 467/949] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:38.986335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:39.012156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:39.012790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.013067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.013340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.021146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:39.021990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:39.033295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:39.045581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:39.046540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:39.047486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 483/950] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:39.053300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:39.130149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24f09-f219-48e4-ac1a-b85d62f1d687 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:39.164806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:39.165472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.165713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.165982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.166605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:39.166902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:39.168259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:39.171327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684a3fb-cc5d-4ee5-9bab-f812c2b6c877 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:39.173402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 468/951] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:39.179496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:39.216949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:39.217874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.218151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.218418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.219091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:39.219390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:39.220798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:39.237209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 484/952] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:39.243769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:39.279729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:39.289887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:39.297368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbf790-5f52-4065-9ef7-7c7b5dac19e2 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:39.345100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6f9f5-ceea-457b-981f-ede4c545df52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:39.346512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f9f5-ceea-457b-981f-ede4c545df52 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.347018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f9f5-ceea-457b-981f-ede4c545df52 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.347499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f9f5-ceea-457b-981f-ede4c545df52 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.348915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f9f5-ceea-457b-981f-ede4c545df52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:39.350009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f9f5-ceea-457b-981f-ede4c545df52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:39.352161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f9f5-ceea-457b-981f-ede4c545df52 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:39.359596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 469/953] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:39.361125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c816-ec9e-4e5d-9e14-428da6f75d64 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.361461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c816-ec9e-4e5d-9e14-428da6f75d64 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.361765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698c816-ec9e-4e5d-9e14-428da6f75d64 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.362957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824063-c549-45a1-83ac-a835c54e9027 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:39.363265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 470/954] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:39.369150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698c816-ec9e-4e5d-9e14-428da6f75d64 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:39.401220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff722ca-3ead-41a6-9ba9-223a4e27af9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:39.402043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff722ca-3ead-41a6-9ba9-223a4e27af9c None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.402265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff722ca-3ead-41a6-9ba9-223a4e27af9c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.402537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff722ca-3ead-41a6-9ba9-223a4e27af9c None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/0d67ec68dae046f0b5ae1b2c30b04a20/roles/253befad441c45648ded1351b0fda915` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.404929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff722ca-3ead-41a6-9ba9-223a4e27af9c None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=0d67ec68dae046f0b5ae1b2c30b04a20, role_id=253befad441c45648ded1351b0fda915)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:39.406364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff722ca-3ead-41a6-9ba9-223a4e27af9c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:39.421926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 485/955] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:39 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/0d67ec68dae046f0b5ae1b2c30b04a20/roles/253befad441c45648ded1351b0fda915 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:04:39.423328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d6a5-5b38-42a5-9ad0-f7ce934733fd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.423618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d6a5-5b38-42a5-9ad0-f7ce934733fd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.423874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d6a5-5b38-42a5-9ad0-f7ce934733fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.445396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a860d6a5-5b38-42a5-9ad0-f7ce934733fd None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:39.447129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a860d6a5-5b38-42a5-9ad0-f7ce934733fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:39.512094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698c816-ec9e-4e5d-9e14-428da6f75d64 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:39.531929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 486/956] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:39.562485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:39.563199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.563488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.563740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.564414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:39.565979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:39.590930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 471/957] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:39.806213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d6a5-5b38-42a5-9ad0-f7ce934733fd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:39.824903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:39.917951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d6a5-5b38-42a5-9ad0-f7ce934733fd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:39.961281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:39.961943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:39.962268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:39.962536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:39.963111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:39.964507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:39.973820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:39.974904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:39.976366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 487/958] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:39.980897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:40.008959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:40.095401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6c4d-e741-427d-99b1-48417c438f3c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:40.129403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02a25a-8018-42ea-b4a0-14b1b16ee98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:40.130043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02a25a-8018-42ea-b4a0-14b1b16ee98e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:40.130318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02a25a-8018-42ea-b4a0-14b1b16ee98e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:40.130587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02a25a-8018-42ea-b4a0-14b1b16ee98e None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:40.131210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02a25a-8018-42ea-b4a0-14b1b16ee98e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:40.131507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02a25a-8018-42ea-b4a0-14b1b16ee98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:40.132860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02a25a-8018-42ea-b4a0-14b1b16ee98e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:40.140160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 472/959] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:40.146225 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:40.231875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:40.257033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4dee5-e39c-42d1-a430-16500b098af6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:40.290960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2022b02-37b3-4dcb-8aa2-debfb1c7fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:40.291561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2022b02-37b3-4dcb-8aa2-debfb1c7fbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:40.291837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2022b02-37b3-4dcb-8aa2-debfb1c7fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:40.292107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2022b02-37b3-4dcb-8aa2-debfb1c7fbe4 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:40.292735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2022b02-37b3-4dcb-8aa2-debfb1c7fbe4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:40.293035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2022b02-37b3-4dcb-8aa2-debfb1c7fbe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:40.294417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2022b02-37b3-4dcb-8aa2-debfb1c7fbe4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:40.299404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 488/960] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:40.902433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175eaf-c3c7-469d-8eca-43a44107c1e5 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:40.902938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175eaf-c3c7-469d-8eca-43a44107c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:40.902938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee175eaf-c3c7-469d-8eca-43a44107c1e5 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:40.904481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 473/961] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:40.911227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444556c4-a8ca-4b8e-bf48-c941790e5500 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:40.911635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444556c4-a8ca-4b8e-bf48-c941790e5500 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:40.911821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444556c4-a8ca-4b8e-bf48-c941790e5500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:40.930755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-444556c4-a8ca-4b8e-bf48-c941790e5500 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:40.931941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-444556c4-a8ca-4b8e-bf48-c941790e5500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:40.999844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 489/962] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:41.267836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee175eaf-c3c7-469d-8eca-43a44107c1e5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:41.356119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:41.372923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee175eaf-c3c7-469d-8eca-43a44107c1e5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:41.409571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:41.410267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.410545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.410809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.411456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:41.412866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:41.415460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING keystone.server.flask.common [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 04:04:41.429774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.sql.core [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:04:41.429774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 04:04:41.429774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [parameters: {'user_id': '4504165496434563a994e831fcdab761', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 04:04:41.429774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81657) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e8c7824b-9a40-4c94-8608-ff0e22030d15 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 30 04:04:41.437276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:04:41.438311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application yield resource Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise self.value Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application session.commit() Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:04:41.439339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:04:41.440291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:04:41.441201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application result.read() Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:04:41.444139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [parameters: {'user_id': '4504165496434563a994e831fcdab761', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:41.445366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 04:04:41.447231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 04:04:41.449540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 04:04:41.449540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 04:04:41.449540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:04:41.449540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:04:41.449540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 04:04:41.449540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:41.449540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 474/963] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 30 04:04:41 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:41.450465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444556c4-a8ca-4b8e-bf48-c941790e5500 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:41.468897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da07e-2b0f-488e-867b-a0de160fbe8f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.469175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da07e-2b0f-488e-867b-a0de160fbe8f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.469434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da07e-2b0f-488e-867b-a0de160fbe8f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.477541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 475/964] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:41.478951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ef8bb-188a-4770-b65c-c43c0e8ea933 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.479348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ef8bb-188a-4770-b65c-c43c0e8ea933 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.479611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ef8bb-188a-4770-b65c-c43c0e8ea933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.497885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4c9ef8bb-188a-4770-b65c-c43c0e8ea933 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:41.499557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4c9ef8bb-188a-4770-b65c-c43c0e8ea933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:41.527932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:41.563328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444556c4-a8ca-4b8e-bf48-c941790e5500 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:41.581653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 476/965] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:41.605832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1557-579d-457b-9f5b-da9889045ba6 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.606125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1557-579d-457b-9f5b-da9889045ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.606398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1557-579d-457b-9f5b-da9889045ba6 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.608022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:41.608154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 477/966] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:41.609006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.609476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.609983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.613245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1f02-998d-463c-a055-e35b6e1388b3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.613245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1f02-998d-463c-a055-e35b6e1388b3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.613614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1f02-998d-463c-a055-e35b6e1388b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.618216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:41.620014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:41.632492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:41.633657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:41.634778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 490/967] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:41.636738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d32c1f02-998d-463c-a055-e35b6e1388b3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:41.641574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d32c1f02-998d-463c-a055-e35b6e1388b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:41.641704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:41.735953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 478/968] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:41.748037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f44e-9b59-4aed-8a51-d3610a99e59a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:41.782770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:41.785060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:41.785788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.786068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.786337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.787033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:41.787488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:41.789104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:41.825293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 491/969] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 30 04:04:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:41.854793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1f02-998d-463c-a055-e35b6e1388b3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:41.864874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:41.974512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1f02-998d-463c-a055-e35b6e1388b3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.011784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.012697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.013125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.013386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.014127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.030394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:42.036114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:42.037254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:42.038196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:42.039293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 479/970] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 30 04:04:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:42.045009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.126156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.137634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363ff7b-2e61-4a21-a296-2c0232768f70 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.167782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693d6c7-4d51-4b3f-a04e-32541b02a3cf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.173303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.173961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.174237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.174505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.175082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.176468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:42.188154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:42.189239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:42.190147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:42.192569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 492/971] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:42.198878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.208725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.209340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.209657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.209926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.210591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:42.210888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.212436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.227131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 480/972] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:42.232919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.262767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.315691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61965270-0532-40f6-be87-ee3a67d4d2b1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.341961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8efbb-fc6e-4850-be4f-8ac93b86bfd5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.349676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16421be-dda5-4eba-84a6-76f4cdb63b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.350270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16421be-dda5-4eba-84a6-76f4cdb63b05 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.350544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16421be-dda5-4eba-84a6-76f4cdb63b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.350812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16421be-dda5-4eba-84a6-76f4cdb63b05 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.351431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16421be-dda5-4eba-84a6-76f4cdb63b05 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:42.351727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16421be-dda5-4eba-84a6-76f4cdb63b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.353165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16421be-dda5-4eba-84a6-76f4cdb63b05 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.357791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 493/973] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:42.358929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a14a4-75a2-4c94-ba3f-03cbc8829126 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.359215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a14a4-75a2-4c94-ba3f-03cbc8829126 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.359485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a14a4-75a2-4c94-ba3f-03cbc8829126 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.360681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 494/974] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:42.365263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a14a4-75a2-4c94-ba3f-03cbc8829126 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.369156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.377245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4591d-1aaa-45d2-8660-d478d4e97887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.377898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4591d-1aaa-45d2-8660-d478d4e97887 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.378167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4591d-1aaa-45d2-8660-d478d4e97887 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.378429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4591d-1aaa-45d2-8660-d478d4e97887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.389090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4591d-1aaa-45d2-8660-d478d4e97887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.390535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4591d-1aaa-45d2-8660-d478d4e97887 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-34c4591d-1aaa-45d2-8660-d478d4e97887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:42.404549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:42.405620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:42.406559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:42.406559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:42.406559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:42.407010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 481/975] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:42.408323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216a37-e4e4-47e5-8aed-ec97f6570db7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.408611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216a37-e4e4-47e5-8aed-ec97f6570db7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.408881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216a37-e4e4-47e5-8aed-ec97f6570db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.426940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5f216a37-e4e4-47e5-8aed-ec97f6570db7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:42.428108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5f216a37-e4e4-47e5-8aed-ec97f6570db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:42.466524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a14a4-75a2-4c94-ba3f-03cbc8829126 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.483317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.493877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 482/976] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:42.494695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216a37-e4e4-47e5-8aed-ec97f6570db7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.501026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.501654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.501930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.502195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.502818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:42.503117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.504453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.510292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 495/977] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:42.515763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.614049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216a37-e4e4-47e5-8aed-ec97f6570db7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.625853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.629358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a9fb-a247-42be-9678-f5ca984e01ed None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.651938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.652540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.652814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.653097 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.653747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:42.654045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.655522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.664693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.665287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.665597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.665869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.666562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] RBAC: Adding query filter params (interface=admin, service_id=022a042bf044454ea70bf9b1a3955795, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:42.666867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.668045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 483/978] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:42.668224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.673217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.673613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 496/979] 10.222.0.69 () {56 vars in 1249 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/endpoints?service_id=022a042bf044454ea70bf9b1a3955795&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:42.678748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.726800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.780660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05eb1-48aa-4d9e-ba92-3a10d28d40a8 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.784437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965131-6ac6-4167-be04-b4cfbcd2ef4d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.813128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.813752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.814026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.814296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.814886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.816224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.817825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.818437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:42.818708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:42.818981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:42.822572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 497/980] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:04:42.823314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.826458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:42.827914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:42.841282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:42.842364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 04:04:42.843613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:42.844920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 484/981] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:42.848535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:42.887472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.959514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca12b0-43ad-495f-b746-285ffb20305e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.969259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:42.969913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a2796-fde0-47a1-92c5-ad73bc03718d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:42.998720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:42.999647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.000099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.000376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.001021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:43.002399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:43.008268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:43.008971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.009309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.009602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.010494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:43.010849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:43.012312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:43.025624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 498/982] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:42 2022] POST /identity/v3/services => generated 242 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:43.032313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 485/983] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 30 04:04:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:43.038691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:43.156030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c11e9-b5c9-4dcc-a34e-cb5b9aed9b95 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:43.193322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:43.194042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.194318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.195220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.228004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:43.267034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:43.268463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:43.370709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 499/984] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:43 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:43.376560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:43.465830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:43.479332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e685b-0b9d-41a6-acff-bed5d8cf1d4d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:43.513921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:43.514549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.514825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.515095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.525091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:43.526547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:43.541343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:43.542370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:43.543264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:43.543264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:43.543264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:43.545810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 486/985] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:43.548005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:43.619292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:43.657983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822958c-d87b-424a-9dfb-779758fedbc7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:43.693365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:43.693996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.694274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.694542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.695176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:43.695474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:43.696816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:43.708730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 500/986] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:43.714079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:43.814885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548f4f4-296c-40ab-8d4a-63ae8c09f213 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:43.848606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:43.849232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.849520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.849804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.856448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:43.857903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:43.860344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:43.871083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:43.872101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:43.873013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:43.877086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 487/987] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:43.878314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:43.983533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ff259-d4ae-46eb-ba6a-0203bd36d01b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:44.006391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:44.017761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db44dd-fb4a-4ea4-9f27-181c94dd274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:44.018365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db44dd-fb4a-4ea4-9f27-181c94dd274a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.018685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db44dd-fb4a-4ea4-9f27-181c94dd274a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.018958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db44dd-fb4a-4ea4-9f27-181c94dd274a None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.019639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db44dd-fb4a-4ea4-9f27-181c94dd274a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:44.020458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db44dd-fb4a-4ea4-9f27-181c94dd274a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:44.022092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db44dd-fb4a-4ea4-9f27-181c94dd274a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:44.039537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 501/988] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:44.041204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:44.144274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2958f-a643-4049-9108-7d8d4d50e07a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:44.177738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d3e0-2442-46ca-b77f-06355321a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:44.178344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d3e0-2442-46ca-b77f-06355321a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.178620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d3e0-2442-46ca-b77f-06355321a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.178891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d3e0-2442-46ca-b77f-06355321a0c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.179612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d3e0-2442-46ca-b77f-06355321a0c0 None admin] RBAC: Adding query filter params (role.id=253befad441c45648ded1351b0fda915, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=0d67ec68dae046f0b5ae1b2c30b04a20) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:44.179920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d3e0-2442-46ca-b77f-06355321a0c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:44.181335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d3e0-2442-46ca-b77f-06355321a0c0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:44.187226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 488/989] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:44 2022] GET /identity/v3/role_assignments?user.id=0d67ec68dae046f0b5ae1b2c30b04a20&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=253befad441c45648ded1351b0fda915 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:44.747627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137afbd-7ea3-4c55-aa1a-ee828b30bff8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.747983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137afbd-7ea3-4c55-aa1a-ee828b30bff8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.748170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137afbd-7ea3-4c55-aa1a-ee828b30bff8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.749590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 502/990] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:44.754731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a704-4284-40d3-ab0b-6059c043c05e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.755020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a704-4284-40d3-ab0b-6059c043c05e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.755294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a704-4284-40d3-ab0b-6059c043c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.773883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0f88a704-4284-40d3-ab0b-6059c043c05e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:44.775129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0f88a704-4284-40d3-ab0b-6059c043c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:44.835378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:44.844630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 489/991] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:44.933273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44116012-746b-4847-aba9-dfc9350924be None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.933651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44116012-746b-4847-aba9-dfc9350924be None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.933841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44116012-746b-4847-aba9-dfc9350924be None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.935307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 503/992] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:44.940833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedba4-f7a0-4a8d-9a91-d268e6e11222 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.941117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedba4-f7a0-4a8d-9a91-d268e6e11222 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.941390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedba4-f7a0-4a8d-9a91-d268e6e11222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.959796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5cbedba4-f7a0-4a8d-9a91-d268e6e11222 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:44.960960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5cbedba4-f7a0-4a8d-9a91-d268e6e11222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:45.029547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 490/993] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:45.111073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44116012-746b-4847-aba9-dfc9350924be None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.214628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44116012-746b-4847-aba9-dfc9350924be None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.248978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.249645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.249965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.250400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.251129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.252493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:45.262724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:45.265293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 04:04:45.268282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:45.270838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 504/994] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:45.272068 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedba4-f7a0-4a8d-9a91-d268e6e11222 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.306959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.361059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:45.381543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedba4-f7a0-4a8d-9a91-d268e6e11222 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.406704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:45.417756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bd0fc-89e2-4879-b302-7cb0aacfa3fd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.419148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.419746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.420021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.420285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.420896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:45.421188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.422561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.428453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 491/995] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:45.433977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.461891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.462511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.462782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.463054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.463613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.464939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:45.474107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:45.475347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:45.476381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 505/996] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:45.480917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.544373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7427937-948f-4085-af39-25e4faa526d8 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.588039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.588648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.588919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.589183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.589902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:45.590201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.591655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.596785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07255f3-ee5a-4931-8790-6394acb9e9a7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.602590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 492/997] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:45.603622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.615686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:45.639558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.640319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.640319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.640596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.641246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:45.641563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.642931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.648629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 506/998] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:45.653942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.667172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:45.718911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c1126-8595-4358-9ab9-e8385112b0e5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.755986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.756587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.756873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.757136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.757810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.759157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.762549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a772-e3ed-4c57-8471-41ad5cd2569b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.776869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 493/999] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:45.809621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.810495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.810960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.811459 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.812263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:45.812719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.814330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.821063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 507/1000] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:45.827255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.940825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c292d-1cbb-435c-bdcf-f46f932060b6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.955643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:45.979548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24963b-288b-4f14-a088-5c553b850fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.980153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24963b-288b-4f14-a088-5c553b850fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.980424 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24963b-288b-4f14-a088-5c553b850fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.980687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24963b-288b-4f14-a088-5c553b850fa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.981382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24963b-288b-4f14-a088-5c553b850fa3 None admin] RBAC: Adding query filter params (interface=public, service_id=7c69802be0cc41c4b9d6fa16ea69dc89, region_id=RegionOne) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:45.981708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24963b-288b-4f14-a088-5c553b850fa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.983047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24963b-288b-4f14-a088-5c553b850fa3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.992614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 494/1001] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/endpoints?service_id=7c69802be0cc41c4b9d6fa16ea69dc89&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:45.993795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:46.030966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:46.096507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d949-fa5e-4f37-b0cc-5d3c9334d376 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:46.130697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231349e-5d88-4876-aba1-23a2d6a83904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:46.131352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231349e-5d88-4876-aba1-23a2d6a83904 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.131562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231349e-5d88-4876-aba1-23a2d6a83904 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.131820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231349e-5d88-4876-aba1-23a2d6a83904 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.132418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231349e-5d88-4876-aba1-23a2d6a83904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:46.133774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231349e-5d88-4876-aba1-23a2d6a83904 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:46.140136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 508/1002] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:04:46.184082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebcde-eeda-478f-bb59-3f9ddfbfabb7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.184451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebcde-eeda-478f-bb59-3f9ddfbfabb7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.184635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebcde-eeda-478f-bb59-3f9ddfbfabb7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.186265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 495/1003] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:46.192000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1342c-7d5a-4123-95ed-40f25ce9489d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.192265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1342c-7d5a-4123-95ed-40f25ce9489d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.192500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1342c-7d5a-4123-95ed-40f25ce9489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.212093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5cc1342c-7d5a-4123-95ed-40f25ce9489d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:46.213331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5cc1342c-7d5a-4123-95ed-40f25ce9489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:46.288286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 509/1004] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:46 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:46.555618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebcde-eeda-478f-bb59-3f9ddfbfabb7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:46.661425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebcde-eeda-478f-bb59-3f9ddfbfabb7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:46.694538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:46.695157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.695428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.695690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] PATH_INFO: `/v3/services/image` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.696251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:46.697615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:46.706157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:46.707155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:46.709039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 496/1005] 10.222.0.69 () {56 vars in 1105 bytes} [Tue Aug 30 04:04:46 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:46.713695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1342c-7d5a-4123-95ed-40f25ce9489d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:46.743856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:46.816073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1342c-7d5a-4123-95ed-40f25ce9489d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:46.850648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a860c6-fe1a-4b85-a290-9c8d275093d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:46.851244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a860c6-fe1a-4b85-a290-9c8d275093d8 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.851517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a860c6-fe1a-4b85-a290-9c8d275093d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.851780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a860c6-fe1a-4b85-a290-9c8d275093d8 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.852395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a860c6-fe1a-4b85-a290-9c8d275093d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:46.852689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a860c6-fe1a-4b85-a290-9c8d275093d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:46.854068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a860c6-fe1a-4b85-a290-9c8d275093d8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:46.858891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 510/1006] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:46.864648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:46.910906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:46.976323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d558e-232d-463f-9f58-a733a6ca92df None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:47.012051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f1a5b-8f71-4e3b-84f8-09038baf35d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:47.012707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f1a5b-8f71-4e3b-84f8-09038baf35d9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:47.012981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f1a5b-8f71-4e3b-84f8-09038baf35d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:47.013248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f1a5b-8f71-4e3b-84f8-09038baf35d9 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:47.013945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f1a5b-8f71-4e3b-84f8-09038baf35d9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:47.014242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f1a5b-8f71-4e3b-84f8-09038baf35d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:47.015587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f1a5b-8f71-4e3b-84f8-09038baf35d9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:47.020205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 497/1007] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:47.720349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf6f1-6c73-40cc-8fc8-1e92cb7b86a2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:47.720865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf6f1-6c73-40cc-8fc8-1e92cb7b86a2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:47.720865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf6f1-6c73-40cc-8fc8-1e92cb7b86a2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:47.722288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 511/1008] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:47.727921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be823-6b7c-43fc-b37c-b3421c395a66 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:47.728307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be823-6b7c-43fc-b37c-b3421c395a66 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:47.728467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720be823-6b7c-43fc-b37c-b3421c395a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:47.747164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-720be823-6b7c-43fc-b37c-b3421c395a66 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:47.748336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-720be823-6b7c-43fc-b37c-b3421c395a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:47.817853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 498/1009] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:47 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:48.044136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc21e4-40be-46ab-8194-d1178790c075 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.044472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc21e4-40be-46ab-8194-d1178790c075 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.044652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc21e4-40be-46ab-8194-d1178790c075 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.046133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 512/1010] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:48.050898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9f43-bab2-4a80-8786-eea59178aad3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.051214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9f43-bab2-4a80-8786-eea59178aad3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.051494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e9f43-bab2-4a80-8786-eea59178aad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.069644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fb4e9f43-bab2-4a80-8786-eea59178aad3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:48.070822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fb4e9f43-bab2-4a80-8786-eea59178aad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:48.085302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc21e4-40be-46ab-8194-d1178790c075 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:48.101253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:48.154219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 499/1011] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:48.184067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:48.193109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc21e4-40be-46ab-8194-d1178790c075 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:48.227137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:48.227815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.228094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.228361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.229455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:48.230883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:48.237203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 513/1012] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:48.238537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9f43-bab2-4a80-8786-eea59178aad3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:48.341809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e9f43-bab2-4a80-8786-eea59178aad3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:48.376886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:48.377486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.377788 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.378055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.378692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:48.380148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:48.410431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 500/1013] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:48 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:48.414349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:48.527060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a774bc5-6b6e-4499-8b8a-18dcef7b55c3 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:48.564307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:48.564930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.565198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.565457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.566053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:48.567554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:48.576376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:48.577685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:48.578612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 514/1014] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:48.584125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:48.610061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:48.700287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2083-9fb7-43cd-bdcd-6136c601f8e5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:48.734402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:48.735096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.735309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.735525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.736142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:48.736433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:48.737791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:48.747141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 501/1015] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:48.748760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:48.777795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:48.853561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e23b-113c-4e71-a9d3-64fa8671935c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:48.887455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6274514-2560-43d0-bb5e-f9f7d6b5e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:48.887973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6274514-2560-43d0-bb5e-f9f7d6b5e745 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.888246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6274514-2560-43d0-bb5e-f9f7d6b5e745 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.888513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6274514-2560-43d0-bb5e-f9f7d6b5e745 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.889134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6274514-2560-43d0-bb5e-f9f7d6b5e745 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:48.889435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6274514-2560-43d0-bb5e-f9f7d6b5e745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:48.890807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6274514-2560-43d0-bb5e-f9f7d6b5e745 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:48.900902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 515/1016] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 30 04:04:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:48.902195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:48.974233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df85dca-7322-456b-b92e-d19f6281456a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.974576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df85dca-7322-456b-b92e-d19f6281456a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.974796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df85dca-7322-456b-b92e-d19f6281456a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:48.976482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 516/1017] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:48.982717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e398e6-db65-4639-8f97-cc5e83d24501 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:48.984116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e398e6-db65-4639-8f97-cc5e83d24501 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:48.984392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e398e6-db65-4639-8f97-cc5e83d24501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:49.002713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:49.005272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-12e398e6-db65-4639-8f97-cc5e83d24501 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:49.006547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-12e398e6-db65-4639-8f97-cc5e83d24501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:49.024298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de7094-0c4d-4095-b841-f3b8a5b3738b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:49.061304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959058f-7e46-4662-9aca-bf51e2611fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:49.062479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959058f-7e46-4662-9aca-bf51e2611fe9 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:49.062762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959058f-7e46-4662-9aca-bf51e2611fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:49.063036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959058f-7e46-4662-9aca-bf51e2611fe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:49.063983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959058f-7e46-4662-9aca-bf51e2611fe9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:49.066079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959058f-7e46-4662-9aca-bf51e2611fe9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:49.076758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 517/1018] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:49.097532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 502/1019] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:49.352535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e398e6-db65-4639-8f97-cc5e83d24501 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:49.374996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:49.460735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e398e6-db65-4639-8f97-cc5e83d24501 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:49.502177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebfee3-26c2-438a-92f2-14cf6c9779ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:49.502769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebfee3-26c2-438a-92f2-14cf6c9779ff None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:49.503041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebfee3-26c2-438a-92f2-14cf6c9779ff None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:49.503307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebfee3-26c2-438a-92f2-14cf6c9779ff None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:49.504051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebfee3-26c2-438a-92f2-14cf6c9779ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:49.506047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebfee3-26c2-438a-92f2-14cf6c9779ff None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:49.525595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 518/1020] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:04:49 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:50.402773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ec7b-7ded-41e3-8b9d-cb6f49f59755 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:50.403301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ec7b-7ded-41e3-8b9d-cb6f49f59755 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:50.403301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ec7b-7ded-41e3-8b9d-cb6f49f59755 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:50.404797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 503/1021] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:50.409959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7573be-316b-461a-a7b9-2aeab2da89c7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:50.410377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7573be-316b-461a-a7b9-2aeab2da89c7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:50.410489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7573be-316b-461a-a7b9-2aeab2da89c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:50.428614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1e7573be-316b-461a-a7b9-2aeab2da89c7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:50.429815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1e7573be-316b-461a-a7b9-2aeab2da89c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:50.505110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 519/1022] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:50.777581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386ec7b-7ded-41e3-8b9d-cb6f49f59755 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:50.883456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386ec7b-7ded-41e3-8b9d-cb6f49f59755 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:50.916285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afed852-8a34-4d61-bc9e-8cdc073fcf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:50.916914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed852-8a34-4d61-bc9e-8cdc073fcf9e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:50.917187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed852-8a34-4d61-bc9e-8cdc073fcf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:50.917456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed852-8a34-4d61-bc9e-8cdc073fcf9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:50.918594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afed852-8a34-4d61-bc9e-8cdc073fcf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:50.920013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afed852-8a34-4d61-bc9e-8cdc073fcf9e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:50.921813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 504/1023] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:50.927726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7573be-316b-461a-a7b9-2aeab2da89c7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:50.929930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:51.035341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7573be-316b-461a-a7b9-2aeab2da89c7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:51.070871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb135c-4af2-4b88-bc6a-c1734a1ff873 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.071311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb135c-4af2-4b88-bc6a-c1734a1ff873 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.071579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb135c-4af2-4b88-bc6a-c1734a1ff873 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.072906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 505/1024] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:51.073580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5b323-b605-4251-bfbc-8c07adca856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:51.074155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5b323-b605-4251-bfbc-8c07adca856b None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.074423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5b323-b605-4251-bfbc-8c07adca856b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.074683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5b323-b605-4251-bfbc-8c07adca856b None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.075325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5b323-b605-4251-bfbc-8c07adca856b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:51.076905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5b323-b605-4251-bfbc-8c07adca856b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:51.078212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3ed2-f8f7-4300-b234-da4f1a045794 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.078499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3ed2-f8f7-4300-b234-da4f1a045794 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.078772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3ed2-f8f7-4300-b234-da4f1a045794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.086099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:51.107417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-222d3ed2-f8f7-4300-b234-da4f1a045794 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:51.107417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-222d3ed2-f8f7-4300-b234-da4f1a045794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:51.108151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 520/1025] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:04:50 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:04:51.180180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 506/1026] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:51.449893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24095c-d8e2-406e-a5b2-9414f93df735 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.450441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24095c-d8e2-406e-a5b2-9414f93df735 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.450523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3ed2-f8f7-4300-b234-da4f1a045794 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:51.450877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24095c-d8e2-406e-a5b2-9414f93df735 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.451905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 521/1027] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:51.456682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70c580-d787-4055-83e1-2cfeeafea42c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.456965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70c580-d787-4055-83e1-2cfeeafea42c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.457236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70c580-d787-4055-83e1-2cfeeafea42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.477323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2d70c580-d787-4055-83e1-2cfeeafea42c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:51.478525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2d70c580-d787-4055-83e1-2cfeeafea42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:51.534556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:51.552003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 522/1028] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:51.557321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3ed2-f8f7-4300-b234-da4f1a045794 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:51.597275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:51.597963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.598235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.599095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.601032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:51.610490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:51.615281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:51.616219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:51.618306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 507/1029] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 30 04:04:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:51.622861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70c580-d787-4055-83e1-2cfeeafea42c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:51.723373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70c580-d787-4055-83e1-2cfeeafea42c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:51.756494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:51.757085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.757356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.757651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.758293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:51.758585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:51.759925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:51.769337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 523/1030] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 30 04:04:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:51.775314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:51.820206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:51.872325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:51.881183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de416a-a8f5-47e5-9222-ae59e7f93f00 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:51.917882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:51.918760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.919034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.919455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.925676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa36de-a61f-4520-8df8-0f6c09939271 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:51.929552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:51.930988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:51.947472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:51.948450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:51.949358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:51.949358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:51.949358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:51.950771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 508/1031] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:51.956520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:51.969608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:51.970236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:51.970548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:51.970770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] PATH_INFO: `/v3/services/image` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:51.971337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:51.972964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:51.981570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:51.982567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:51.983857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 524/1032] 10.222.0.69 () {56 vars in 1105 bytes} [Tue Aug 30 04:04:51 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:51.988342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.009638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.064528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1357a-6ead-46be-97cb-90381fdedecd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.092949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5502-14f8-4e05-b16f-19b0a9d9333f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.099184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.099790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.100066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.100333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.100970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:52.101269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.102669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.108216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.115119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 509/1033] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:52.120625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.134031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.134653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.134931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.135210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.135816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] RBAC: Adding query filter params (name=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:52.136138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.137456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.142514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 525/1034] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:52.148412 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.227860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52624684-aa54-4579-b156-d567bf99d370 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.235978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.253969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c696eff-f15b-4328-9e80-fc9aaaa7a485 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.268128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.268752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.269023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.269293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.277016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.278461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:52.290484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:52.291463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:52.292420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 510/1035] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:52.294663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.295430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.295851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.296335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.297093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.297268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] RBAC: Adding query filter params (type=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:52.297792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.299268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.305898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 526/1036] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:52.311892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.356987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.405323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135f824-b75d-4b27-8e16-70fa9f58843d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.419032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18d06-3dd0-4acb-aebb-369907eec740 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.439289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.439886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.440157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.440422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.441331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:52.441443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.443538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.456345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.456956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.457198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.457461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.458366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] RBAC: Adding query filter params (interface=public, service_id=66b763eeef8e4e6fbda828d0ee403e9d, region_id=RegionOne) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:52.458664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.459976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.464471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 511/1037] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:52.466126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 527/1038] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/endpoints?service_id=66b763eeef8e4e6fbda828d0ee403e9d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:52.470334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.471713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.497154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.581175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323c8b-8100-47a8-98c8-7345a7ed955f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.584590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fab7c9-5447-4811-9118-a976587e3b8a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.594405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.618559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.619161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.619435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.619701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.624898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.625498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.625796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.626061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.626654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.628320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.641543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 528/1039] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:04:52.704409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.705915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.732993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:52.813461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 512/1040] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:52.819527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:52.921027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b3af1-8f41-48e4-87d6-76df3357a806 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:52.957136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecee94-b9fb-42a7-b4dc-2426777a6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:52.958674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecee94-b9fb-42a7-b4dc-2426777a6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:52.959165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecee94-b9fb-42a7-b4dc-2426777a6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:52.959639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecee94-b9fb-42a7-b4dc-2426777a6eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:52.970287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecee94-b9fb-42a7-b4dc-2426777a6eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:52.971968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecee94-b9fb-42a7-b4dc-2426777a6eb5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-73ecee94-b9fb-42a7-b4dc-2426777a6eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:52.989646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:52.990661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:52.991569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:52.991569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:52.991569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:52.993714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 529/1041] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:52.999206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:53.083612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f12a-34c6-4958-a2ab-060146825692 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.083793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f12a-34c6-4958-a2ab-060146825692 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.084061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f12a-34c6-4958-a2ab-060146825692 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.085398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 530/1042] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:53.090254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5318db-dc97-43f7-acd1-52c3430a77c2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.090537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5318db-dc97-43f7-acd1-52c3430a77c2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.090808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5318db-dc97-43f7-acd1-52c3430a77c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.102807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3809805-d012-4f1b-b3d7-2aab4d6d0d1d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:53.111433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6b5318db-dc97-43f7-acd1-52c3430a77c2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:53.112628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6b5318db-dc97-43f7-acd1-52c3430a77c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:53.128470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:53.130133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:53.141898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:53.142505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.142780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.143146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.143906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:53.144205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:53.146107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:53.162730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 513/1043] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:53.163744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:53.189145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 531/1044] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:53.263268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9daa28-6e49-4a8c-ba39-2e6d4e00d12f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:53.297487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:53.298222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.298563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.298891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.305549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:53.307038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:53.318691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:53.319794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:53.320955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:53.326253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 514/1045] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:53.326907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5318db-dc97-43f7-acd1-52c3430a77c2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:53.426996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5318db-dc97-43f7-acd1-52c3430a77c2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:53.461011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:53.461652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.461907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.462180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.462868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:53.463170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:53.463516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:53.464662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:53.481682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 532/1046] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:53.483154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:53.499710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:53.518146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:53.584298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32267db7-d24a-4286-a68a-55dae2c87d40 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:53.591912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f91cc8-0f35-459d-9089-71181f4271cc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:53.624160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:53.624858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.625138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.625413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.630352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:53.631103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.631378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.631643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.632361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] RBAC: Adding query filter params (role.id=253befad441c45648ded1351b0fda915, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=c8b82c351b9340ee88bbb4a9b490847f) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:53.632664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:53.634108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:53.637087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:53.639794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 533/1047] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:53 2022] GET /identity/v3/role_assignments?user.id=c8b82c351b9340ee88bbb4a9b490847f&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=253befad441c45648ded1351b0fda915 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:53.641903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:53.642830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:53.643706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 515/1048] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:53.649792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:53.738522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:53.764822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bfcb5-8b9d-4a6b-9380-a6a621f3e8e1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:53.807500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:53.808101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.808371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.808636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.809294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:53.809614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:53.810964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:53.825120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 534/1049] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:53.826675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:53.927573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d3248-d029-4bda-b547-4feb4234f505 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:53.929931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:53.965634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:53.966271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:53.966547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:53.966818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] PATH_INFO: `/v3/users/f455c76bcfdb4afca4c1e2daa4521a0f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:53.981377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] RBAC: Authorizing `identity:get_user(user_id=f455c76bcfdb4afca4c1e2daa4521a0f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:53.982849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:53.984669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 516/1050] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:04:53 2022] GET /identity/v3/users/f455c76bcfdb4afca4c1e2daa4521a0f => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:53.990763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:54.096333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb14616-5943-4311-8470-f6979ce0b7cd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:54.130672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:54.131266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:54.131542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:54.131807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:54.140162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:54.201331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:54.202789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:54.302150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 535/1051] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:04:54.307673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:54.407770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bb8a0-2c10-4326-a06f-45bb2fbf2d05 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:54.441756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55d609-9bac-4e2f-90a9-ebe864c30dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:54.442941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55d609-9bac-4e2f-90a9-ebe864c30dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:54.443216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55d609-9bac-4e2f-90a9-ebe864c30dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:54.443483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55d609-9bac-4e2f-90a9-ebe864c30dd1 None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:54.444591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55d609-9bac-4e2f-90a9-ebe864c30dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=b58fa4f12ba640d7a38c3b12b1961261)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:54.446057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55d609-9bac-4e2f-90a9-ebe864c30dd1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:54.452908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 517/1052] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:04:54 2022] GET /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:54.453872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:54.493926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:54.555488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73959ecb-5cd7-420b-b50a-c853d296d589 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:54.564824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef29b-cea8-43d1-9245-0aa27c9f1373 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:54.565333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef29b-cea8-43d1-9245-0aa27c9f1373 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:54.565445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef29b-cea8-43d1-9245-0aa27c9f1373 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:54.566875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 518/1053] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:54.572090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e170-fdc7-43a8-8716-9d1446156dc3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:54.572388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e170-fdc7-43a8-8716-9d1446156dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:54.572655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9e170-fdc7-43a8-8716-9d1446156dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:54.595575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-35c9e170-fdc7-43a8-8716-9d1446156dc3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:54.596941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-35c9e170-fdc7-43a8-8716-9d1446156dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:54.603569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:54.604750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:54.605177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:54.605638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:54.606850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=b58fa4f12ba640d7a38c3b12b1961261, user.id=f455c76bcfdb4afca4c1e2daa4521a0f) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:54.607320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:54.609216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:54.615652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 536/1054] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:04:54 2022] GET /identity/v3/role_assignments?user.id=f455c76bcfdb4afca4c1e2daa4521a0f&scope.project.id=b58fa4f12ba640d7a38c3b12b1961261&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:54.634669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:54.685261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 519/1055] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:54.953542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:55.060558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc6a11-a163-4d34-9d60-8f1a288df0ca None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:55.062251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:55.096835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:55.097461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:55.097762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:55.098033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] PATH_INFO: `/v3/services/image` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:55.099125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:55.100468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:55.109415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:55.110570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:55.111449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 537/1056] 10.222.0.69 () {56 vars in 1105 bytes} [Tue Aug 30 04:04:54 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:55.117051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e170-fdc7-43a8-8716-9d1446156dc3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:55.219261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9e170-fdc7-43a8-8716-9d1446156dc3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:55.258472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:55.259423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:55.259943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:55.260465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:55.261304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] RBAC: Adding query filter params (name=image) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:55.261837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:55.263392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:55.269008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 520/1057] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:55.278822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:55.386460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c709d-79ba-4d1e-9622-4f8d5b7e1fea None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:55.421716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30813f-1484-49ca-b7f0-2f00dc2a083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:55.422317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30813f-1484-49ca-b7f0-2f00dc2a083e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:55.422593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30813f-1484-49ca-b7f0-2f00dc2a083e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:55.422856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30813f-1484-49ca-b7f0-2f00dc2a083e None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:55.423478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30813f-1484-49ca-b7f0-2f00dc2a083e None admin] RBAC: Adding query filter params (type=image) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:55.423773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30813f-1484-49ca-b7f0-2f00dc2a083e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:55.425110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30813f-1484-49ca-b7f0-2f00dc2a083e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:55.434935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 538/1058] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:55.436365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:55.464074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:55.542177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0a09-b6c0-4b2c-bbcf-7be60905bf20 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:55.546935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff183-9c13-49b2-9bbf-c924f933aa37 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:55.547392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff183-9c13-49b2-9bbf-c924f933aa37 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:55.547467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff183-9c13-49b2-9bbf-c924f933aa37 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:55.549104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 539/1059] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:55.554715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fd2c-5fa6-4da5-9d25-45a986f8ec57 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:55.555105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fd2c-5fa6-4da5-9d25-45a986f8ec57 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:55.555377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134fd2c-5fa6-4da5-9d25-45a986f8ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:55.575241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d134fd2c-5fa6-4da5-9d25-45a986f8ec57 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:55.576472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d134fd2c-5fa6-4da5-9d25-45a986f8ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:55.591961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:55.592814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:55.593193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:55.593900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:55.594723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:55.596773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:55.607110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:55.637845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 521/1060] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:04:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:04:55.671308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 540/1061] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:55.936538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:56.019158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:56.042670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b13d7-f674-495c-a3ff-ef2ff3a729ad None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:56.081065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:56.081964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.082406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.082880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.094695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:56.099784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:56.100942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:04:56.101998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:56.106183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 522/1062] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 30 04:04:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:56.108776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134fd2c-5fa6-4da5-9d25-45a986f8ec57 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:56.209240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134fd2c-5fa6-4da5-9d25-45a986f8ec57 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:56.242677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:56.243273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.243542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.243805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.244445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:56.244739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:56.246095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:56.254019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 541/1063] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 30 04:04:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:56.260037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:56.358786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569b2a-7b6b-416a-8feb-6037af1a08f9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:56.391385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b66df3-fb3d-4473-80af-6546cd9486b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:56.391999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b66df3-fb3d-4473-80af-6546cd9486b7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.392275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b66df3-fb3d-4473-80af-6546cd9486b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.392540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b66df3-fb3d-4473-80af-6546cd9486b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.401138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:56.404044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b66df3-fb3d-4473-80af-6546cd9486b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:56.405587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b66df3-fb3d-4473-80af-6546cd9486b7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-79b66df3-fb3d-4473-80af-6546cd9486b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:56.420592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:56.421670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:56.422591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:56.422591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:56.422591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:56.423314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 523/1064] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:56.428040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:56.448661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:56.534144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eed72-85d9-4db9-92d1-12bea070bc69 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:56.539394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af4b2f-67bd-4d4b-9c83-c1bcd85d41a0 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.539681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af4b2f-67bd-4d4b-9c83-c1bcd85d41a0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.539956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af4b2f-67bd-4d4b-9c83-c1bcd85d41a0 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.541578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 524/1065] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:56.546331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3a46-3b03-43e3-a3d9-e7b373825b40 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.546617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3a46-3b03-43e3-a3d9-e7b373825b40 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.546891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d3a46-3b03-43e3-a3d9-e7b373825b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.565754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-937d3a46-3b03-43e3-a3d9-e7b373825b40 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:56.566942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-937d3a46-3b03-43e3-a3d9-e7b373825b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:56.571467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:56.572072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.572350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.572623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.573257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:56.573580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:56.575340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:56.590856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 542/1066] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:56.596620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:56.649664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 525/1067] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:04:56.682334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:56.704815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227bbf3-2599-4d57-bd2e-370050166e36 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:56.741565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:56.742195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.742466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.742729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.750370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:56.751800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:04:56.764223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:56.765192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:56.766721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 543/1068] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:04:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:56.773303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d3a46-3b03-43e3-a3d9-e7b373825b40 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:56.872966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d3a46-3b03-43e3-a3d9-e7b373825b40 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:56.894640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:56.907590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:56.908188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:56.908461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:56.908722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:56.909429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:56.909756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:56.911701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:56.916682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:56.933264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 526/1069] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:04:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:56.934263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.027830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d32f-d73a-4c36-8526-7b771b0482d7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.043918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8837f-7f96-46c0-9498-13b34d96ae18 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.062413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.063031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.063302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.063562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.071941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.077445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:04:57.082651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:57.084210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:04:57.085099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:57.085811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.085811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.085811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.085811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.089356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 544/1070] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:04:57.090224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.097893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.099763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:57.115614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:57.116795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:57.117946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:57.117946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:57.117946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:57.117946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 527/1071] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:57.122476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.156055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.197790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c3675-c6cb-48a9-b740-6e612520160f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.229465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8179-10e0-42e1-94f0-214e7c812c8b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.234086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.234789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.235165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.235532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.236547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:57.236800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.238485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.252874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 545/1072] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:57.253987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.269042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.269678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.269950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.270215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.271449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:57.271743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.273097 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.289873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 528/1073] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:57.290745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.318686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.366425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f12a6-ed67-46e0-8ef7-79b469e52213 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.403477 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.404101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.404427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.404904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.405178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] PATH_INFO: `/v3/users/f455c76bcfdb4afca4c1e2daa4521a0f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.406898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] RBAC: Authorizing `identity:get_user(user_id=f455c76bcfdb4afca4c1e2daa4521a0f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.408791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.415443 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 546/1074] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:04:57 2022] GET /identity/v3/users/f455c76bcfdb4afca4c1e2daa4521a0f => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:04:57.415598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec24511-bbaa-4a3c-8350-15bbee8a0738 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.416403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.454119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.454749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.455023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.455292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.462159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.463483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:04:57.474956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:57.475893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:04:57.476815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 529/1075] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:57.481702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.523859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b32ac4-06b9-4c47-bb3d-f19bb8587191 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.552921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.561252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.561903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.562175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.562439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.563715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] RBAC: Authorizing `identity:get_project(project_id=b58fa4f12ba640d7a38c3b12b1961261)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.564935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.566737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 547/1076] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:04:57 2022] GET /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:57.572914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.594553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89da54a-c14e-4bb4-a457-31b3276c0f3b None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.628189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b39ce-db5b-4433-9b05-930f91835921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.628790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b39ce-db5b-4433-9b05-930f91835921 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.629063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b39ce-db5b-4433-9b05-930f91835921 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.629331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b39ce-db5b-4433-9b05-930f91835921 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.630612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b39ce-db5b-4433-9b05-930f91835921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:57.630910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b39ce-db5b-4433-9b05-930f91835921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.632316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b39ce-db5b-4433-9b05-930f91835921 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.643478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 530/1077] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:57.649736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7bc12-9a5c-46f4-9740-8d4929fbde0d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.650309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7bc12-9a5c-46f4-9740-8d4929fbde0d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.650309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7bc12-9a5c-46f4-9740-8d4929fbde0d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.651503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 531/1078] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:57.652173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7bc12-9a5c-46f4-9740-8d4929fbde0d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:57.667633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.673063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82c26-19a9-46b9-8156-0f55a1e27cbc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.713079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81323d2-5a6d-4c4a-aaa2-33ac429a0eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.714248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81323d2-5a6d-4c4a-aaa2-33ac429a0eb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.714733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81323d2-5a6d-4c4a-aaa2-33ac429a0eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.715140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81323d2-5a6d-4c4a-aaa2-33ac429a0eb7 None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261/users/f455c76bcfdb4afca4c1e2daa4521a0f/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.717059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81323d2-5a6d-4c4a-aaa2-33ac429a0eb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b58fa4f12ba640d7a38c3b12b1961261, user_id=f455c76bcfdb4afca4c1e2daa4521a0f, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.718498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81323d2-5a6d-4c4a-aaa2-33ac429a0eb7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.732230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 548/1079] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:57 2022] PUT /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261/users/f455c76bcfdb4afca4c1e2daa4521a0f/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:04:57.733423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0175c-7f27-4ca1-9ba2-ec2b2d5bebd2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.733734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0175c-7f27-4ca1-9ba2-ec2b2d5bebd2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.734002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0175c-7f27-4ca1-9ba2-ec2b2d5bebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.754878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ccf0175c-7f27-4ca1-9ba2-ec2b2d5bebd2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:57.756115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ccf0175c-7f27-4ca1-9ba2-ec2b2d5bebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:57.764969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7bc12-9a5c-46f4-9740-8d4929fbde0d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:57.804651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:57.805347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:57.805641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:57.805911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/c8b82c351b9340ee88bbb4a9b490847f/roles/253befad441c45648ded1351b0fda915` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:57.808177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=c8b82c351b9340ee88bbb4a9b490847f, role_id=253befad441c45648ded1351b0fda915)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:57.809751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:57.816646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.827336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 532/1080] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:04:57 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/c8b82c351b9340ee88bbb4a9b490847f/roles/253befad441c45648ded1351b0fda915 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:04:57.839382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 549/1081] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:58.118655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:58.191909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:58.224829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7e58e-c7e7-4f03-bf2d-0e7f3319bc3c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:58.258900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:58.259597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:58.259876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:58.260137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:58.328119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:58.329587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:58.398351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:58.433559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 533/1082] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:04:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:04:58.435561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0175c-7f27-4ca1-9ba2-ec2b2d5bebd2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:58.533935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0175c-7f27-4ca1-9ba2-ec2b2d5bebd2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:58.566617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c79134-deb9-4012-9270-427e6e80fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:58.567267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79134-deb9-4012-9270-427e6e80fa4c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:58.568093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79134-deb9-4012-9270-427e6e80fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:58.568359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79134-deb9-4012-9270-427e6e80fa4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:58.579483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c79134-deb9-4012-9270-427e6e80fa4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:58.581658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c79134-deb9-4012-9270-427e6e80fa4c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-90c79134-deb9-4012-9270-427e6e80fa4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:04:58.597644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:04:58.598632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:04:58.604438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:04:58.604438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:04:58.604438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:04:58.604438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 550/1083] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:04:58.604678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:58.706401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f96f-af7e-4d7a-9296-9758059454a0 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:58.742180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8615462-b074-41b4-b43e-640afed24d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:58.742779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8615462-b074-41b4-b43e-640afed24d4d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:58.743054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8615462-b074-41b4-b43e-640afed24d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:58.743326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8615462-b074-41b4-b43e-640afed24d4d None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:58.743958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8615462-b074-41b4-b43e-640afed24d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:04:58.744258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8615462-b074-41b4-b43e-640afed24d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:58.745632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8615462-b074-41b4-b43e-640afed24d4d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:58.757978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 534/1084] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:04:59.671952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7643-f080-4787-9e7a-2c637026b8de None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:59.672469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7643-f080-4787-9e7a-2c637026b8de None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:59.672469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb7643-f080-4787-9e7a-2c637026b8de None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:59.673908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 551/1085] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:59.679173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eab014-f8af-4f0e-a632-9e6471794a2c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:59.679456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eab014-f8af-4f0e-a632-9e6471794a2c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:59.679729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eab014-f8af-4f0e-a632-9e6471794a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:59.697646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-46eab014-f8af-4f0e-a632-9e6471794a2c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:59.698819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-46eab014-f8af-4f0e-a632-9e6471794a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:59.725127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:59.738942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70be6b-3813-4c58-9936-f7dc6b32449e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:59.739219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70be6b-3813-4c58-9936-f7dc6b32449e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:59.739490 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70be6b-3813-4c58-9936-f7dc6b32449e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:59.740815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 552/1086] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:59.745849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358881d4-1839-4454-b1e7-d7acc6080a16 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:59.746124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358881d4-1839-4454-b1e7-d7acc6080a16 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:59.746392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358881d4-1839-4454-b1e7-d7acc6080a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:59.763659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-358881d4-1839-4454-b1e7-d7acc6080a16 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:59.764818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-358881d4-1839-4454-b1e7-d7acc6080a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:59.766903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 535/1087] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:04:59.794105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:59.830279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 553/1088] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:05:00.035102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eab014-f8af-4f0e-a632-9e6471794a2c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.093426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358881d4-1839-4454-b1e7-d7acc6080a16 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.132375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eab014-f8af-4f0e-a632-9e6471794a2c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.165791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.166419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.166694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.166964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.177100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:00.181839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:00.185712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:05:00.186817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 536/1089] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:00.188899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.195793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358881d4-1839-4454-b1e7-d7acc6080a16 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.213321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.229264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.229911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.230190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.230460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.240188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:00.245126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:00.246352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:00.247208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 554/1090] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:05:00.252036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.280133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.291439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903e815-1781-4a3b-8130-cfe43a473d52 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.325137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.325775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.326051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.326326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.326982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:00.327288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.328643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.337339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 537/1091] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:05:00.342992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.350276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f200-932a-4b17-8d40-bddcb2999070 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.384230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.384840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.385107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.385375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.386070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:00.386368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.388584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.396394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 555/1092] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:05:00.402144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.442303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.459542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ee5c-3bc7-42a8-acf0-e6b03d98f717 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.488404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.493152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.493883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.494156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.494423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] PATH_INFO: `/v3/users/f455c76bcfdb4afca4c1e2daa4521a0f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.495550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=f455c76bcfdb4afca4c1e2daa4521a0f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.496974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.498178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ff56-7d89-4f82-a9b9-ae233ab4e48c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.498576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 538/1093] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/users/f455c76bcfdb4afca4c1e2daa4521a0f => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:05:00.504355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.531899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.532521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.532798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.533068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.543245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.544593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:05:00.558859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:00.559999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:05:00.561652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:05:00.561652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:05:00.561652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:00.561652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 556/1094] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:05:00.565610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.605431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a722-d3f1-4c0f-aac6-577642672ec9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.639046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.639879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.640168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.640434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.662564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.664745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018abf38-25d1-438f-a4ea-cc09567a0ae0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.697206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.697843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.698100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.698369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.699003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:00.699302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.700654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.708520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.709975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.712553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 557/1095] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:05:00.718106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.720899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.812379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 539/1096] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:05:00.819039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.823597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d78e8-c32f-4c4f-ae60-fe3c0bbabc4c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.856941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.857583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.857862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.858130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.865305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.866748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.869144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:05:00.878964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:00.880531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:00.881637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 558/1097] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:05:00.886099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.919004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840064c2-bea4-4c38-b9bf-c9dd709ffc90 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:00.946665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:00.952638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:00.953293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:00.953603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:00.953877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:00.955044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] RBAC: Authorizing `identity:get_project(project_id=b58fa4f12ba640d7a38c3b12b1961261)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:00.956464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:00.958772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 540/1098] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:05:00.965106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:00.985593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fb6e-3b94-44e3-848d-4b92c0125265 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:01.018732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:01.019324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:01.019596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:01.019856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:01.020600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:01.021425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:01.022836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:01.039964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 559/1099] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:05:01.045679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:01.062512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e7f4-bc90-4b69-8735-3ff954dec781 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:01.086941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:01.102535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:01.103234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:01.103501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:01.103771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:01.104493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=b58fa4f12ba640d7a38c3b12b1961261, user.id=f455c76bcfdb4afca4c1e2daa4521a0f) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:01.104798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:01.106246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:01.111911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 541/1100] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:00 2022] GET /identity/v3/role_assignments?user.id=f455c76bcfdb4afca4c1e2daa4521a0f&scope.project.id=b58fa4f12ba640d7a38c3b12b1961261&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:05:01.151982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3277f7-8467-4d7d-bc22-51e8a3597dee None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:01.174424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:01.191287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:01.191898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:01.192172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:01.192510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:01.263970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:01.265394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:01.363845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 560/1101] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:05:01.370046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:01.468192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13791d12-dabf-4893-bd00-be58c0ef1f90 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:01.501259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:01.501914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:01.502187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:01.502453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:01.513295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:01.514750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:05:01.528386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:01.529537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:05:01.530747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:05:01.530747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:05:01.530747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:05:01.533672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 542/1102] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:01.535123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:01.557185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:01.636152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255ab20-26fe-410a-982f-2d9188f7e7ed None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:01.669053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:01.669680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:01.669958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:01.670223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:01.670855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:01.671154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:01.672492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:01.684013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 561/1103] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:01.689735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:01.724613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:01.788589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72089a2f-b624-4893-8659-c60fa47e30e1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:01.821582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:01.822188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:01.822463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:01.822731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:01.829134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:01.830591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:05:01.842206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:01.843237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:05:01.844415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 543/1104] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:01.850276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:01.929065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:01.948548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b016ea6-1e2b-46e9-a591-744094318a54 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:01.981313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119ab94-424c-4909-9504-b99a6dc9b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:01.981947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119ab94-424c-4909-9504-b99a6dc9b9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:01.982220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119ab94-424c-4909-9504-b99a6dc9b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:01.982483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119ab94-424c-4909-9504-b99a6dc9b9e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:01.983155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119ab94-424c-4909-9504-b99a6dc9b9e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:01.983450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119ab94-424c-4909-9504-b99a6dc9b9e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:01.984844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119ab94-424c-4909-9504-b99a6dc9b9e1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:01.996410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 562/1105] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:02.002446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:02.094522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:02.101146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449e57-f69b-411f-94f1-08444124fede None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:02.133074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c3ea0-6def-468f-aec0-0b765091bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:02.133693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ea0-6def-468f-aec0-0b765091bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:02.133966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ea0-6def-468f-aec0-0b765091bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:02.134232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ea0-6def-468f-aec0-0b765091bdc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:02.134942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c3ea0-6def-468f-aec0-0b765091bdc1 None admin] RBAC: Adding query filter params (role.id=253befad441c45648ded1351b0fda915, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=c8b82c351b9340ee88bbb4a9b490847f) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:02.135242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c3ea0-6def-468f-aec0-0b765091bdc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:02.136652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c3ea0-6def-468f-aec0-0b765091bdc1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:02.142270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 544/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:02 2022] GET /identity/v3/role_assignments?user.id=c8b82c351b9340ee88bbb4a9b490847f&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=253befad441c45648ded1351b0fda915 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:03.053186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f92f-ee50-4222-b6c6-49fc060f3540 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:03.053701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f92f-ee50-4222-b6c6-49fc060f3540 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:03.053701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f92f-ee50-4222-b6c6-49fc060f3540 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:03.055024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 563/1107] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:03.060074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1230-a053-49cb-948e-98d94702ab1a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:03.060508 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1230-a053-49cb-948e-98d94702ab1a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:03.060603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1230-a053-49cb-948e-98d94702ab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:03.082522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0f1a1230-a053-49cb-948e-98d94702ab1a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:03.083722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0f1a1230-a053-49cb-948e-98d94702ab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:03.147680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 545/1108] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:03.411711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f92f-ee50-4222-b6c6-49fc060f3540 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:03.509096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f92f-ee50-4222-b6c6-49fc060f3540 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:03.542333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f06fc-af57-40c0-b2a4-2506cb431802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:03.542934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f06fc-af57-40c0-b2a4-2506cb431802 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:03.543203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f06fc-af57-40c0-b2a4-2506cb431802 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:03.543463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f06fc-af57-40c0-b2a4-2506cb431802 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:03.544537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f06fc-af57-40c0-b2a4-2506cb431802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:03.545956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f06fc-af57-40c0-b2a4-2506cb431802 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:03.547486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 564/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:03.553178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a1230-a053-49cb-948e-98d94702ab1a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:03.639622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:03.649271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a1230-a053-49cb-948e-98d94702ab1a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:03.681423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ac6f7-b3ed-418b-9bee-1bc9ee1ac88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:03.682000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac6f7-b3ed-418b-9bee-1bc9ee1ac88c None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:03.682271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac6f7-b3ed-418b-9bee-1bc9ee1ac88c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:03.682534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac6f7-b3ed-418b-9bee-1bc9ee1ac88c None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:03.683160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ac6f7-b3ed-418b-9bee-1bc9ee1ac88c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:03.684560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ac6f7-b3ed-418b-9bee-1bc9ee1ac88c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:03.704579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 546/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:05:03 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:05:05.633856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d508d6-505a-45f3-b708-b25a22a2bb52 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:05.634366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d508d6-505a-45f3-b708-b25a22a2bb52 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:05.634366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d508d6-505a-45f3-b708-b25a22a2bb52 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:05.635756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 565/1111] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:05.640954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0d749-ad61-443b-9a20-32fe835e3fcb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:05.641329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0d749-ad61-443b-9a20-32fe835e3fcb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:05.641493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0d749-ad61-443b-9a20-32fe835e3fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:05.659713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e4f0d749-ad61-443b-9a20-32fe835e3fcb None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:05.660880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e4f0d749-ad61-443b-9a20-32fe835e3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:05.724664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 547/1112] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:05.988742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d508d6-505a-45f3-b708-b25a22a2bb52 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:05.999564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:06.087376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d508d6-505a-45f3-b708-b25a22a2bb52 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:06.120436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:06.121036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:06.121311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:06.121603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] PATH_INFO: `/v3/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:06.122969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] RBAC: Authorizing `identity:get_role(role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:06.124302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:06.125609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 566/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:05 2022] GET /identity/v3/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:06.131549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0d749-ad61-443b-9a20-32fe835e3fcb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:06.205446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:06.229368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0d749-ad61-443b-9a20-32fe835e3fcb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:06.262530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:06.263109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:06.263385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:06.263656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] PATH_INFO: `/v3/users/28718614797f439a9e1133d0008ce45e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:06.276214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] RBAC: Authorizing `identity:get_user(user_id=28718614797f439a9e1133d0008ce45e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:06.277671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:06.279248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 548/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:06 2022] GET /identity/v3/users/28718614797f439a9e1133d0008ce45e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:06.284910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:06.359030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:06.381736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94284ea6-edab-4843-b3b2-46932323a99e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:06.414620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:06.415195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:06.415475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:06.415748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:06.479963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:06.481367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:06.552298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:06.575057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 567/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:05:06.580878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:06.676888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639f8f-41a4-496d-b5ab-d19b7814a393 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:06.708895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44d4f1-3a93-4689-ac30-3099ed35d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:06.709495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44d4f1-3a93-4689-ac30-3099ed35d134 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:06.709792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44d4f1-3a93-4689-ac30-3099ed35d134 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:06.710053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44d4f1-3a93-4689-ac30-3099ed35d134 None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:06.711136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44d4f1-3a93-4689-ac30-3099ed35d134 None admin] RBAC: Authorizing `identity:get_project(project_id=b58fa4f12ba640d7a38c3b12b1961261)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:06.712530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44d4f1-3a93-4689-ac30-3099ed35d134 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:06.714143 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 549/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:06 2022] GET /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:06.720564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:06.815587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baff35-7e2f-42d0-997f-b374b9026ae7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:06.848807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d5940-991d-4d9d-a6a8-9af2ac4ffc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:06.849416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d5940-991d-4d9d-a6a8-9af2ac4ffc79 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:06.849720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d5940-991d-4d9d-a6a8-9af2ac4ffc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:06.849991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d5940-991d-4d9d-a6a8-9af2ac4ffc79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:06.850701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d5940-991d-4d9d-a6a8-9af2ac4ffc79 None admin] RBAC: Adding query filter params (role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=b58fa4f12ba640d7a38c3b12b1961261, user.id=28718614797f439a9e1133d0008ce45e) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:06.851008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d5940-991d-4d9d-a6a8-9af2ac4ffc79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:06.852406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d5940-991d-4d9d-a6a8-9af2ac4ffc79 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:06.857557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 568/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:06 2022] GET /identity/v3/role_assignments?user.id=28718614797f439a9e1133d0008ce45e&scope.project.id=b58fa4f12ba640d7a38c3b12b1961261&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:08.692471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47968a53-e670-4549-afec-bdf0efc5bc15 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:08.693574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47968a53-e670-4549-afec-bdf0efc5bc15 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:08.693676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47968a53-e670-4549-afec-bdf0efc5bc15 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:08.694977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 550/1118] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:08.699974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a28474-d694-4954-a01c-42214f24ccd8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:08.700401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a28474-d694-4954-a01c-42214f24ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:08.700508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a28474-d694-4954-a01c-42214f24ccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:08.718198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a1a28474-d694-4954-a01c-42214f24ccd8 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:08.719623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a1a28474-d694-4954-a01c-42214f24ccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:08.752618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:08.784781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 569/1119] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:09.053397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47968a53-e670-4549-afec-bdf0efc5bc15 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:09.056244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:09.157489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47968a53-e670-4549-afec-bdf0efc5bc15 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:09.190387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:09.190998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:09.191267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:09.191529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] PATH_INFO: `/v3/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:09.192917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] RBAC: Authorizing `identity:get_role(role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:09.194290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:09.195589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 551/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:09 2022] GET /identity/v3/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:09.201366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a28474-d694-4954-a01c-42214f24ccd8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:09.297596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a28474-d694-4954-a01c-42214f24ccd8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:09.330654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:09.331192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:09.331461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:09.331721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] PATH_INFO: `/v3/users/28718614797f439a9e1133d0008ce45e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:09.332813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] RBAC: Authorizing `identity:get_user(user_id=28718614797f439a9e1133d0008ce45e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:09.334260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:09.335969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 570/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:09 2022] GET /identity/v3/users/28718614797f439a9e1133d0008ce45e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:09.341769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:09.418751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:09.452971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b486-4331-45de-9fb4-be1ffc2de0ca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:09.490583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46baa-5383-4686-b129-9175d927082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:09.491635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46baa-5383-4686-b129-9175d927082e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:09.492052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46baa-5383-4686-b129-9175d927082e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:09.492332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46baa-5383-4686-b129-9175d927082e None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:09.493546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46baa-5383-4686-b129-9175d927082e None admin] RBAC: Authorizing `identity:get_project(project_id=b58fa4f12ba640d7a38c3b12b1961261)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:09.494977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46baa-5383-4686-b129-9175d927082e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:09.496609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 552/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:09 2022] GET /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:09.502580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:09.544150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:09.605059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1ae2e-134c-4bfe-856d-522148ffe16f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:09.638508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cd1a5-c2c2-48e4-94a7-67ca9b08a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:09.639146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd1a5-c2c2-48e4-94a7-67ca9b08a69f None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:09.639422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd1a5-c2c2-48e4-94a7-67ca9b08a69f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:09.639683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cd1a5-c2c2-48e4-94a7-67ca9b08a69f None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261/users/28718614797f439a9e1133d0008ce45e/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:09.641838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cd1a5-c2c2-48e4-94a7-67ca9b08a69f None admin] RBAC: Authorizing `identity:create_grant(project_id=b58fa4f12ba640d7a38c3b12b1961261, user_id=28718614797f439a9e1133d0008ce45e, role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:09.643317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cd1a5-c2c2-48e4-94a7-67ca9b08a69f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:09.656029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 571/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:05:09 2022] PUT /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261/users/28718614797f439a9e1133d0008ce45e/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:05:11.547449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42ebc-aeb2-4eb2-b58a-e2181100475d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:11.548003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42ebc-aeb2-4eb2-b58a-e2181100475d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:11.548003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b42ebc-aeb2-4eb2-b58a-e2181100475d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:11.549311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 553/1124] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:11.554464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a1cd-c525-4a92-97cf-2f89e8070b1b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:11.554861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a1cd-c525-4a92-97cf-2f89e8070b1b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:11.555000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a1cd-c525-4a92-97cf-2f89e8070b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:11.572962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2961a1cd-c525-4a92-97cf-2f89e8070b1b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:11.574150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2961a1cd-c525-4a92-97cf-2f89e8070b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:11.640578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 572/1125] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:11.911213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b42ebc-aeb2-4eb2-b58a-e2181100475d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:12.009180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b42ebc-aeb2-4eb2-b58a-e2181100475d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:12.041248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:12.041871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:12.042143 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:12.042407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] PATH_INFO: `/v3/roles/71a6ce23ac0e4c87803f8093d2cfb3c6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:12.043764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] RBAC: Authorizing `identity:get_role(role_id=71a6ce23ac0e4c87803f8093d2cfb3c6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:12.045105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:12.046421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 554/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:11 2022] GET /identity/v3/roles/71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:12.052078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a1cd-c525-4a92-97cf-2f89e8070b1b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:12.078723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:12.147617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a1cd-c525-4a92-97cf-2f89e8070b1b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:12.180242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:12.180792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:12.181068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:12.181336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] PATH_INFO: `/v3/users/28718614797f439a9e1133d0008ce45e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:12.182606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=28718614797f439a9e1133d0008ce45e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:12.184009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:12.185574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 573/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:12 2022] GET /identity/v3/users/28718614797f439a9e1133d0008ce45e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:12.191249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:12.200009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:12.288888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0fad9-ddd6-43d4-80b1-d4bbda24e8a3 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:12.321240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:12.321861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:12.322140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:12.322409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:12.387901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:12.389327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:12.397097 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:12.485866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 555/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:05:12.491804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:12.580667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:12.587352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3713-eafd-464d-9f28-e160e116a7d7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:12.620912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291382be-378a-4b22-87b5-3a4c51bed181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:12.621542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291382be-378a-4b22-87b5-3a4c51bed181 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:12.621824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291382be-378a-4b22-87b5-3a4c51bed181 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:12.622091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291382be-378a-4b22-87b5-3a4c51bed181 None admin] PATH_INFO: `/v3/projects/b58fa4f12ba640d7a38c3b12b1961261` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:12.623188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291382be-378a-4b22-87b5-3a4c51bed181 None admin] RBAC: Authorizing `identity:get_project(project_id=b58fa4f12ba640d7a38c3b12b1961261)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:12.624582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291382be-378a-4b22-87b5-3a4c51bed181 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:12.626225 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 574/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:12 2022] GET /identity/v3/projects/b58fa4f12ba640d7a38c3b12b1961261 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:12.632493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:12.728689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018269a1-88a7-4d72-9a86-f29ecee301ca None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:12.735650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:12.761822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741144b7-9e47-4b4f-a4aa-b82d3fa26ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:12.762346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741144b7-9e47-4b4f-a4aa-b82d3fa26ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:12.762624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741144b7-9e47-4b4f-a4aa-b82d3fa26ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:12.762891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741144b7-9e47-4b4f-a4aa-b82d3fa26ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:12.763601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741144b7-9e47-4b4f-a4aa-b82d3fa26ed9 None admin] RBAC: Adding query filter params (role.id=71a6ce23ac0e4c87803f8093d2cfb3c6, scope.project.id=b58fa4f12ba640d7a38c3b12b1961261, user.id=28718614797f439a9e1133d0008ce45e) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:12.763903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741144b7-9e47-4b4f-a4aa-b82d3fa26ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:12.765304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741144b7-9e47-4b4f-a4aa-b82d3fa26ed9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:12.771063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 556/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:12 2022] GET /identity/v3/role_assignments?user.id=28718614797f439a9e1133d0008ce45e&scope.project.id=b58fa4f12ba640d7a38c3b12b1961261&role.id=71a6ce23ac0e4c87803f8093d2cfb3c6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:14.676261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62d2db-269a-4201-bdbf-ffed45bbdab4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:14.676738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62d2db-269a-4201-bdbf-ffed45bbdab4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:14.676829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62d2db-269a-4201-bdbf-ffed45bbdab4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:14.678172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 575/1131] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:14.683210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbef72-881d-43c7-bc34-8fa15f9cba42 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:14.683643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbef72-881d-43c7-bc34-8fa15f9cba42 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:14.683744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbef72-881d-43c7-bc34-8fa15f9cba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:14.701761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-54cbef72-881d-43c7-bc34-8fa15f9cba42 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:14.702951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-54cbef72-881d-43c7-bc34-8fa15f9cba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:14.767085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 557/1132] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:15.031351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62d2db-269a-4201-bdbf-ffed45bbdab4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:15.128266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62d2db-269a-4201-bdbf-ffed45bbdab4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:15.163302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f530d-9eb8-425b-b8e4-5bd966a3a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:15.163904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f530d-9eb8-425b-b8e4-5bd966a3a38d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:15.164175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f530d-9eb8-425b-b8e4-5bd966a3a38d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:15.164438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f530d-9eb8-425b-b8e4-5bd966a3a38d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:15.165541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f530d-9eb8-425b-b8e4-5bd966a3a38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:15.166935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f530d-9eb8-425b-b8e4-5bd966a3a38d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:15.168465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 576/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:15.174253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbef72-881d-43c7-bc34-8fa15f9cba42 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:15.266541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:15.269219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbef72-881d-43c7-bc34-8fa15f9cba42 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:15.302150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896071f-2f43-496d-8817-8a780292242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:15.302679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896071f-2f43-496d-8817-8a780292242c None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:15.302949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896071f-2f43-496d-8817-8a780292242c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:15.303211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896071f-2f43-496d-8817-8a780292242c None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:15.303838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896071f-2f43-496d-8817-8a780292242c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:15.305232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896071f-2f43-496d-8817-8a780292242c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:15.330532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 558/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:05:15 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:05:17.260905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bfb44-8f2d-49cc-9894-b21a7b21e5ff None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:17.261429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bfb44-8f2d-49cc-9894-b21a7b21e5ff None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:17.261429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bfb44-8f2d-49cc-9894-b21a7b21e5ff None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:17.262838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 577/1135] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:17.268935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed5ef6-9bec-44aa-9784-272443ae80d4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:17.269333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed5ef6-9bec-44aa-9784-272443ae80d4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:17.269490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed5ef6-9bec-44aa-9784-272443ae80d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:17.287968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9fed5ef6-9bec-44aa-9784-272443ae80d4 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:17.289168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9fed5ef6-9bec-44aa-9784-272443ae80d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:17.369810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 559/1136] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:17.640158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bfb44-8f2d-49cc-9894-b21a7b21e5ff None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:17.671211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:17.740157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bfb44-8f2d-49cc-9894-b21a7b21e5ff None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:17.772689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a777665-75ff-432b-bec9-708bfe957d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:17.773299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777665-75ff-432b-bec9-708bfe957d35 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:17.773600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777665-75ff-432b-bec9-708bfe957d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:17.773874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777665-75ff-432b-bec9-708bfe957d35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:17.774970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a777665-75ff-432b-bec9-708bfe957d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:17.776374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a777665-75ff-432b-bec9-708bfe957d35 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:17.777949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 578/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:05:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:17.783604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed5ef6-9bec-44aa-9784-272443ae80d4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:17.861835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:17.879393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed5ef6-9bec-44aa-9784-272443ae80d4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:17.911557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d34d61-a2be-4480-8dec-bee193b16251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:17.912713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34d61-a2be-4480-8dec-bee193b16251 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:17.912986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34d61-a2be-4480-8dec-bee193b16251 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:17.913249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d34d61-a2be-4480-8dec-bee193b16251 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:17.913905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34d61-a2be-4480-8dec-bee193b16251 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:17.915304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d34d61-a2be-4480-8dec-bee193b16251 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:17.936163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 560/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:05:17 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:05:19.882557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265bc9f-f6f9-47ed-b2a7-be45b2aaca89 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:19.883054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265bc9f-f6f9-47ed-b2a7-be45b2aaca89 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:19.883054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265bc9f-f6f9-47ed-b2a7-be45b2aaca89 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:19.884326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 579/1139] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:19.889344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c323-2e6a-45a6-b694-b2458c92263c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:19.889789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c323-2e6a-45a6-b694-b2458c92263c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:19.889919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c323-2e6a-45a6-b694-b2458c92263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:19.908186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9bc8c323-2e6a-45a6-b694-b2458c92263c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:19.909359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9bc8c323-2e6a-45a6-b694-b2458c92263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:19.976318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 561/1140] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:20.243319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265bc9f-f6f9-47ed-b2a7-be45b2aaca89 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:20.336721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:20.340665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265bc9f-f6f9-47ed-b2a7-be45b2aaca89 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:20.372314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:20.372903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:20.373171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:20.373436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:20.383524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:20.388168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:20.389365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:20.390545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 580/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:20.395330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c323-2e6a-45a6-b694-b2458c92263c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:20.464527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:20.499292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c323-2e6a-45a6-b694-b2458c92263c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:20.531983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:20.532570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:20.532839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:20.533101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:20.533767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:20.534060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:20.535410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:20.543036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 562/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:20.548953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:20.646190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5694d-b5a8-474d-ab52-8426ab314308 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:20.679838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:20.680449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:20.680726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:20.680999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] PATH_INFO: `/v3/users/e310b17a53404216ae711595a5045643` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:20.694182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] RBAC: Authorizing `identity:get_user(user_id=e310b17a53404216ae711595a5045643)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:20.695590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:20.697160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 581/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:20 2022] GET /identity/v3/users/e310b17a53404216ae711595a5045643 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:20.703179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:20.814248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500093cc-1d9e-4623-9b0a-d129c740524d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:20.842699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:20.849032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:20.849663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:20.849938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:20.850202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:20.914260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:20.915695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:21.011028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 563/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:05:21.017251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:21.035359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:21.112877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc26e0-5110-4ce6-9c4d-f259ce8d8864 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:21.145502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dca33-ee31-48af-8a27-dc4e2bf11208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:21.146123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dca33-ee31-48af-8a27-dc4e2bf11208 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:21.146395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dca33-ee31-48af-8a27-dc4e2bf11208 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:21.146688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dca33-ee31-48af-8a27-dc4e2bf11208 None admin] PATH_INFO: `/v3/projects/6d7e28c614894269932782818f4b8d07` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:21.147795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dca33-ee31-48af-8a27-dc4e2bf11208 None admin] RBAC: Authorizing `identity:get_project(project_id=6d7e28c614894269932782818f4b8d07)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:21.150249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dca33-ee31-48af-8a27-dc4e2bf11208 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:21.151629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 582/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:21 2022] GET /identity/v3/projects/6d7e28c614894269932782818f4b8d07 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:21.157848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:21.187595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:21.254756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d87be8-9a59-435c-b4e3-b983e0d538a9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:21.286888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f1c75-1d88-4b6d-9bb7-cfcb9f99e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:21.287979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1c75-1d88-4b6d-9bb7-cfcb9f99e10d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:21.288257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1c75-1d88-4b6d-9bb7-cfcb9f99e10d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:21.288528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f1c75-1d88-4b6d-9bb7-cfcb9f99e10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:21.289242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f1c75-1d88-4b6d-9bb7-cfcb9f99e10d None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=6d7e28c614894269932782818f4b8d07, user.id=e310b17a53404216ae711595a5045643) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:21.289578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f1c75-1d88-4b6d-9bb7-cfcb9f99e10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:21.290991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f1c75-1d88-4b6d-9bb7-cfcb9f99e10d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:21.296160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 564/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:21 2022] GET /identity/v3/role_assignments?user.id=e310b17a53404216ae711595a5045643&scope.project.id=6d7e28c614894269932782818f4b8d07&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:23.154123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be0917-b78b-4f0a-997c-cb9f55cf17fa None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:23.154659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be0917-b78b-4f0a-997c-cb9f55cf17fa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:23.154659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be0917-b78b-4f0a-997c-cb9f55cf17fa None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:23.155989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 583/1147] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:23.161138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c31027-44ff-4f9b-9419-56b770e8a972 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:23.161549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c31027-44ff-4f9b-9419-56b770e8a972 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:23.161722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c31027-44ff-4f9b-9419-56b770e8a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:23.181049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e9c31027-44ff-4f9b-9419-56b770e8a972 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:23.182278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e9c31027-44ff-4f9b-9419-56b770e8a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:23.246928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 565/1148] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:23.515101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be0917-b78b-4f0a-997c-cb9f55cf17fa None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:23.597730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:23.614049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be0917-b78b-4f0a-997c-cb9f55cf17fa None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:23.647362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:23.647971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:23.648247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:23.648515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:23.658393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:23.663710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:23.664858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:23.665936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 584/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:23.670730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c31027-44ff-4f9b-9419-56b770e8a972 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:23.694646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:23.768032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c31027-44ff-4f9b-9419-56b770e8a972 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:23.801380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:23.801997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:23.802273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:23.802542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:23.803228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:23.803526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:23.804879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:23.812654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 566/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:23.818300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:23.918101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7a856-9cd4-4d22-a19e-cec62120b144 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:23.949908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:23.950515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:23.950788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:23.951056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] PATH_INFO: `/v3/users/e310b17a53404216ae711595a5045643` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:23.952150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=e310b17a53404216ae711595a5045643)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:23.953573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:23.955121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 585/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:23 2022] GET /identity/v3/users/e310b17a53404216ae711595a5045643 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:23.961353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:24.044004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:24.059013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da6bd3-3c58-4ff0-9ada-260560cac324 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:24.090544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cadfe-954a-488a-b727-2cb178bde524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:24.091152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cadfe-954a-488a-b727-2cb178bde524 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:24.091429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cadfe-954a-488a-b727-2cb178bde524 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:24.091698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cadfe-954a-488a-b727-2cb178bde524 None admin] PATH_INFO: `/v3/projects/6d7e28c614894269932782818f4b8d07` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:24.092800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cadfe-954a-488a-b727-2cb178bde524 None admin] RBAC: Authorizing `identity:get_project(project_id=6d7e28c614894269932782818f4b8d07)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:24.094243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cadfe-954a-488a-b727-2cb178bde524 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:24.096112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 567/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:23 2022] GET /identity/v3/projects/6d7e28c614894269932782818f4b8d07 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:24.102474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:24.118182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:24.197973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e32a-9c95-4010-8ab3-20f2e24d1ea4 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:24.230434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a619-0d3c-4f9e-81a6-669f1ad2e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:24.231056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a619-0d3c-4f9e-81a6-669f1ad2e3f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:24.231329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a619-0d3c-4f9e-81a6-669f1ad2e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:24.231595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a619-0d3c-4f9e-81a6-669f1ad2e3f0 None admin] PATH_INFO: `/v3/projects/6d7e28c614894269932782818f4b8d07/users/e310b17a53404216ae711595a5045643/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:24.233444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a619-0d3c-4f9e-81a6-669f1ad2e3f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d7e28c614894269932782818f4b8d07, user_id=e310b17a53404216ae711595a5045643, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:24.234869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a619-0d3c-4f9e-81a6-669f1ad2e3f0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:24.246891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 586/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:05:24 2022] PUT /identity/v3/projects/6d7e28c614894269932782818f4b8d07/users/e310b17a53404216ae711595a5045643/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:05:26.100904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb917b9-90fa-46e3-b0e2-1bb2be4f704e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:26.101428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb917b9-90fa-46e3-b0e2-1bb2be4f704e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:26.101428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb917b9-90fa-46e3-b0e2-1bb2be4f704e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:26.102791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 568/1154] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:26.107819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fab333-74ee-44bc-af1c-cc6b95f98e48 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:26.108187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fab333-74ee-44bc-af1c-cc6b95f98e48 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:26.108364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fab333-74ee-44bc-af1c-cc6b95f98e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:26.126594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-96fab333-74ee-44bc-af1c-cc6b95f98e48 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:26.127768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-96fab333-74ee-44bc-af1c-cc6b95f98e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:26.192966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 587/1155] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:26.463227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb917b9-90fa-46e3-b0e2-1bb2be4f704e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:26.562887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb917b9-90fa-46e3-b0e2-1bb2be4f704e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:26.595075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:26.595945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:26.596219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:26.596484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:26.607396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:26.612145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:26.613227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:05:26.614352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 569/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:05:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:26.619871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fab333-74ee-44bc-af1c-cc6b95f98e48 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:26.622943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:26.715651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fab333-74ee-44bc-af1c-cc6b95f98e48 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:26.748290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:26.748875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:26.749152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:26.749421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:26.750098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:26.750395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:26.751735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:26.759580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 588/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:05:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:26.765172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:26.781490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:26.863815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0654-be2f-4ff3-bc5a-43d04d1961b1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:26.898574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:26.899188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:26.899468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:26.899741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] PATH_INFO: `/v3/users/e310b17a53404216ae711595a5045643` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:26.900859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] RBAC: Authorizing `identity:get_user(user_id=e310b17a53404216ae711595a5045643)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:26.902310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:26.903879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 570/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:26 2022] GET /identity/v3/users/e310b17a53404216ae711595a5045643 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:26.909761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:26.975117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:27.009318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b5deb-9ffd-4cff-a5bf-da0575a69ea7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:27.042670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:27.043259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:27.043535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:27.043805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:27.108140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:27.109581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:27.174206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:27.209922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 589/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:05:27.215846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:27.295115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:27.313294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7dfe9-783b-4312-b685-ebf7a008de0f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:27.345185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a79a7-f6b7-41de-8003-882fe3469803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:27.346071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a79a7-f6b7-41de-8003-882fe3469803 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:27.346341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a79a7-f6b7-41de-8003-882fe3469803 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:27.346603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a79a7-f6b7-41de-8003-882fe3469803 None admin] PATH_INFO: `/v3/projects/6d7e28c614894269932782818f4b8d07` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:27.347684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a79a7-f6b7-41de-8003-882fe3469803 None admin] RBAC: Authorizing `identity:get_project(project_id=6d7e28c614894269932782818f4b8d07)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:27.349079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a79a7-f6b7-41de-8003-882fe3469803 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:27.351237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 571/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:27 2022] GET /identity/v3/projects/6d7e28c614894269932782818f4b8d07 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:27.357216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:27.450814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c96c9-69cb-495b-b147-911758ace48a None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:27.483681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8e24-bf9a-4b01-94c4-fbbb5e11aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:27.484256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e24-bf9a-4b01-94c4-fbbb5e11aea9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:27.484525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e24-bf9a-4b01-94c4-fbbb5e11aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:27.484789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e24-bf9a-4b01-94c4-fbbb5e11aea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:27.485494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed8e24-bf9a-4b01-94c4-fbbb5e11aea9 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=6d7e28c614894269932782818f4b8d07, user.id=e310b17a53404216ae711595a5045643) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:27.485822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed8e24-bf9a-4b01-94c4-fbbb5e11aea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:27.487219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed8e24-bf9a-4b01-94c4-fbbb5e11aea9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:27.492728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 590/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:27 2022] GET /identity/v3/role_assignments?user.id=e310b17a53404216ae711595a5045643&scope.project.id=6d7e28c614894269932782818f4b8d07&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:29.414964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35309bab-6f09-4c1a-a2b9-0e9e2bb69597 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:29.415490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35309bab-6f09-4c1a-a2b9-0e9e2bb69597 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:29.415490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35309bab-6f09-4c1a-a2b9-0e9e2bb69597 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:29.416860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 572/1162] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:29.422355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764f09-cd07-4240-8810-9dbf734a0ff3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:29.422788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764f09-cd07-4240-8810-9dbf734a0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:29.422890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764f09-cd07-4240-8810-9dbf734a0ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:29.440324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dc764f09-cd07-4240-8810-9dbf734a0ff3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:29.441467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dc764f09-cd07-4240-8810-9dbf734a0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:29.464978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:29.506189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 591/1163] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:29.774536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35309bab-6f09-4c1a-a2b9-0e9e2bb69597 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:29.873039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35309bab-6f09-4c1a-a2b9-0e9e2bb69597 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:29.905201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:29.905814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:29.906092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:29.906364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:29.923791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:29.971809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:29.973248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:30.067394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 573/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:05:30.073940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764f09-cd07-4240-8810-9dbf734a0ff3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:30.167632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764f09-cd07-4240-8810-9dbf734a0ff3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:30.199498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121df04-f595-4d22-b947-246bd5852c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:30.200098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121df04-f595-4d22-b947-246bd5852c1f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:30.200370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121df04-f595-4d22-b947-246bd5852c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:30.200635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121df04-f595-4d22-b947-246bd5852c1f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:30.206941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121df04-f595-4d22-b947-246bd5852c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:30.208339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121df04-f595-4d22-b947-246bd5852c1f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-c121df04-f595-4d22-b947-246bd5852c1f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:30.219202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:30.220438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:30.221739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 592/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:05:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:30.226750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:30.273258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:30.320686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7a53-4151-4fa6-a246-74ca477d0840 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:30.352881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75657578-f981-45d6-b996-0dd605f64fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:30.353455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657578-f981-45d6-b996-0dd605f64fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:30.353752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657578-f981-45d6-b996-0dd605f64fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:30.354016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657578-f981-45d6-b996-0dd605f64fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:30.354639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75657578-f981-45d6-b996-0dd605f64fa0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:30.354935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75657578-f981-45d6-b996-0dd605f64fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:30.356264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75657578-f981-45d6-b996-0dd605f64fa0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:30.362996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 574/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 30 04:05:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:32.218745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487605-2767-4a53-87c0-a4871d7fa9a7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:32.219284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487605-2767-4a53-87c0-a4871d7fa9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:32.219284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487605-2767-4a53-87c0-a4871d7fa9a7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:32.220900 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 593/1167] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:32.226516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed026-60fe-46e5-aeb4-7d5f55ed52b3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:32.227044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed026-60fe-46e5-aeb4-7d5f55ed52b3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:32.227044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed026-60fe-46e5-aeb4-7d5f55ed52b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:32.246415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-dfaed026-60fe-46e5-aeb4-7d5f55ed52b3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:32.247584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dfaed026-60fe-46e5-aeb4-7d5f55ed52b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:32.311639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 575/1168] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:32.574991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1487605-2767-4a53-87c0-a4871d7fa9a7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:32.597188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:32.675572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1487605-2767-4a53-87c0-a4871d7fa9a7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:32.707223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a014ccd-f9a9-4c79-8388-779bce5342d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:32.707812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014ccd-f9a9-4c79-8388-779bce5342d2 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:32.708090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014ccd-f9a9-4c79-8388-779bce5342d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:32.708360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a014ccd-f9a9-4c79-8388-779bce5342d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:32.709543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a014ccd-f9a9-4c79-8388-779bce5342d2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:32.710874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a014ccd-f9a9-4c79-8388-779bce5342d2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:32.726832 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 594/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Tue Aug 30 04:05:32 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:05:34.646003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414fad-59d0-45ec-a107-a6b21d8f613f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:34.647139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414fad-59d0-45ec-a107-a6b21d8f613f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:34.647249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26414fad-59d0-45ec-a107-a6b21d8f613f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:34.648563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 576/1170] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:34.653691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ab6ef-1091-4b14-a845-21a7c5e93d0b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:34.654122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ab6ef-1091-4b14-a845-21a7c5e93d0b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:34.654221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ab6ef-1091-4b14-a845-21a7c5e93d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:34.672621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-838ab6ef-1091-4b14-a845-21a7c5e93d0b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:34.673806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-838ab6ef-1091-4b14-a845-21a7c5e93d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:34.737744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 595/1171] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:35.004977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26414fad-59d0-45ec-a107-a6b21d8f613f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:35.051328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:35.105266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26414fad-59d0-45ec-a107-a6b21d8f613f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:35.138699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a20054-036a-4394-b91b-f19d24212aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:35.139309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a20054-036a-4394-b91b-f19d24212aea None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:35.139584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a20054-036a-4394-b91b-f19d24212aea None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:35.139853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a20054-036a-4394-b91b-f19d24212aea None admin] PATH_INFO: `/v3/domains/6f2f312b6b15407fab9a196555519a33` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:35.149812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a20054-036a-4394-b91b-f19d24212aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=6f2f312b6b15407fab9a196555519a33)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:35.151295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a20054-036a-4394-b91b-f19d24212aea None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:35.152854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 577/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Tue Aug 30 04:05:35 2022] GET /identity/v3/domains/6f2f312b6b15407fab9a196555519a33 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:35.158721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ab6ef-1091-4b14-a845-21a7c5e93d0b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:35.169863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:35.259952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ab6ef-1091-4b14-a845-21a7c5e93d0b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:35.291770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b41f08-70ac-43d7-84ab-c1f8288f5df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:35.292352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b41f08-70ac-43d7-84ab-c1f8288f5df7 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:35.292623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b41f08-70ac-43d7-84ab-c1f8288f5df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:35.292907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b41f08-70ac-43d7-84ab-c1f8288f5df7 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:35.293567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b41f08-70ac-43d7-84ab-c1f8288f5df7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:35.294969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b41f08-70ac-43d7-84ab-c1f8288f5df7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:35.320201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 596/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:05:35 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:05:37.224252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321e6fc-efa5-4ce8-b523-17f4f4aae308 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:37.226111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321e6fc-efa5-4ce8-b523-17f4f4aae308 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:37.226410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321e6fc-efa5-4ce8-b523-17f4f4aae308 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:37.227805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 578/1174] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:37.234805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d032a6-940d-4f2f-8527-943a6f71d64e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:37.235242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d032a6-940d-4f2f-8527-943a6f71d64e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:37.235349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d032a6-940d-4f2f-8527-943a6f71d64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:37.253134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a5d032a6-940d-4f2f-8527-943a6f71d64e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:37.254340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a5d032a6-940d-4f2f-8527-943a6f71d64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:37.308579 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:37.319535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 597/1175] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:37.585046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321e6fc-efa5-4ce8-b523-17f4f4aae308 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:37.683284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321e6fc-efa5-4ce8-b523-17f4f4aae308 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:37.685521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:37.716488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7797a6-f318-4f58-b6bf-270487195494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:37.717098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7797a6-f318-4f58-b6bf-270487195494 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:37.717371 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7797a6-f318-4f58-b6bf-270487195494 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:37.717669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7797a6-f318-4f58-b6bf-270487195494 None admin] PATH_INFO: `/v3/domains/6f2f312b6b15407fab9a196555519a33` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:37.718765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7797a6-f318-4f58-b6bf-270487195494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6f2f312b6b15407fab9a196555519a33)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:37.720441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7797a6-f318-4f58-b6bf-270487195494 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:37.722023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 579/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Tue Aug 30 04:05:37 2022] GET /identity/v3/domains/6f2f312b6b15407fab9a196555519a33 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:37.727629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d032a6-940d-4f2f-8527-943a6f71d64e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:37.822504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d032a6-940d-4f2f-8527-943a6f71d64e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:37.856092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbbe33-7998-4e11-bdd7-2ed1196f60f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:37.856675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbe33-7998-4e11-bdd7-2ed1196f60f8 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:37.856950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbe33-7998-4e11-bdd7-2ed1196f60f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:37.857220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbbe33-7998-4e11-bdd7-2ed1196f60f8 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:37.857894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbbe33-7998-4e11-bdd7-2ed1196f60f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:37.859300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbbe33-7998-4e11-bdd7-2ed1196f60f8 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:37.879204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 598/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:05:37 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:05:39.797783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4713b-d072-42e7-8528-890bce9ebd1a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:39.798291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4713b-d072-42e7-8528-890bce9ebd1a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:39.798402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4713b-d072-42e7-8528-890bce9ebd1a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:39.799664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 580/1178] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:39.804794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055d06-03f6-43a4-9e78-0f71f4129f94 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:39.805180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055d06-03f6-43a4-9e78-0f71f4129f94 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:39.805331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7055d06-03f6-43a4-9e78-0f71f4129f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:39.823356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d7055d06-03f6-43a4-9e78-0f71f4129f94 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:39.824515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d7055d06-03f6-43a4-9e78-0f71f4129f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:39.867984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:39.890111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 599/1179] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:40.156439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4713b-d072-42e7-8528-890bce9ebd1a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:40.255293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4713b-d072-42e7-8528-890bce9ebd1a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:40.287836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:40.288448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:40.288726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:40.288994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:40.299169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:40.303937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:40.305112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:05:40.306182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 581/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:40.310856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055d06-03f6-43a4-9e78-0f71f4129f94 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:40.404799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7055d06-03f6-43a4-9e78-0f71f4129f94 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:40.436983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:40.437530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:40.437803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:40.438068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:40.438710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:40.439003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:40.440336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:40.447943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 600/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:05:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:40.453485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:40.485080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:40.550959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa79ffa-39fc-496b-827a-1232f500732d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:40.583683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:40.584303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:40.584578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:40.584847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] PATH_INFO: `/v3/users/cb9904e7d5c64ac39a9e64746d3fe195` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:40.598220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9904e7d5c64ac39a9e64746d3fe195)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:40.599652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:40.601249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 582/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:40 2022] GET /identity/v3/users/cb9904e7d5c64ac39a9e64746d3fe195 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:40.607135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:40.648387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:40.703242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d9635-47ed-43cb-8377-35d8c07b34b5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:40.735234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:40.735802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:40.736075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:40.736341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:40.799886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:40.801294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:40.839189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:40.896166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 601/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:05:40.902002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:40.990199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:41.000419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e56dd-3270-49b5-84e5-c5c488137786 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:41.033383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68dcc0-5868-40e2-9bcc-a02da79ef0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:41.034023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68dcc0-5868-40e2-9bcc-a02da79ef0ea None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:41.034302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68dcc0-5868-40e2-9bcc-a02da79ef0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:41.034574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68dcc0-5868-40e2-9bcc-a02da79ef0ea None admin] PATH_INFO: `/v3/projects/f0d69458f70b4139b4895d398502bbf4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:41.035703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68dcc0-5868-40e2-9bcc-a02da79ef0ea None admin] RBAC: Authorizing `identity:get_project(project_id=f0d69458f70b4139b4895d398502bbf4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:41.037126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68dcc0-5868-40e2-9bcc-a02da79ef0ea None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:41.038774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 583/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:40 2022] GET /identity/v3/projects/f0d69458f70b4139b4895d398502bbf4 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:41.044759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:41.140685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc36b4-4f96-45ad-9267-bb0e4798c97d None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:41.173632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0f2f9-b398-4168-852c-f0fea3811ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:41.174214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0f2f9-b398-4168-852c-f0fea3811ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:41.174490 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0f2f9-b398-4168-852c-f0fea3811ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:41.174759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0f2f9-b398-4168-852c-f0fea3811ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:41.175468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0f2f9-b398-4168-852c-f0fea3811ac5 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=f0d69458f70b4139b4895d398502bbf4, user.id=cb9904e7d5c64ac39a9e64746d3fe195) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:41.175772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0f2f9-b398-4168-852c-f0fea3811ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:41.177708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0f2f9-b398-4168-852c-f0fea3811ac5 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:41.182873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 602/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:41 2022] GET /identity/v3/role_assignments?user.id=cb9904e7d5c64ac39a9e64746d3fe195&scope.project.id=f0d69458f70b4139b4895d398502bbf4&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:43.059576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f90fe-b79d-485d-8cf3-9b22a0ee79c3 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:43.060133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f90fe-b79d-485d-8cf3-9b22a0ee79c3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:43.060133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f90fe-b79d-485d-8cf3-9b22a0ee79c3 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:43.061444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 584/1186] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:43.066593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe6c82-d3de-4548-8fdc-521d1c6574e9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:43.066967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe6c82-d3de-4548-8fdc-521d1c6574e9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:43.067133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe6c82-d3de-4548-8fdc-521d1c6574e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:43.074258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:43.085250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8dbe6c82-d3de-4548-8fdc-521d1c6574e9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:43.086460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8dbe6c82-d3de-4548-8fdc-521d1c6574e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:43.151033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 603/1187] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:43.420791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f90fe-b79d-485d-8cf3-9b22a0ee79c3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:43.518156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f90fe-b79d-485d-8cf3-9b22a0ee79c3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:43.550668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:43.551262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:43.551533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:43.551796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:43.561307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:43.566011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:43.567595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:05:43.568655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 585/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:43.573598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe6c82-d3de-4548-8fdc-521d1c6574e9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:43.670101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe6c82-d3de-4548-8fdc-521d1c6574e9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:43.702562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:43.703096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:43.703375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:43.703647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:43.704296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:43.704594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:43.705975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:43.707867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:43.715329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 604/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:43.721543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:43.740755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:43.819452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7c387-a339-4769-a5c8-e3cabb3b062f None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:43.853061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:43.853692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:43.853996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:43.854267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] PATH_INFO: `/v3/users/cb9904e7d5c64ac39a9e64746d3fe195` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:43.855374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9904e7d5c64ac39a9e64746d3fe195)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:43.856776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:43.858356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 586/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:43 2022] GET /identity/v3/users/cb9904e7d5c64ac39a9e64746d3fe195 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:43.864184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:43.970840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54f032-5294-46f6-9960-367e4df991bf None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:44.003107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7543-3005-47a8-ab56-c1b0985d9b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:44.003779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7543-3005-47a8-ab56-c1b0985d9b07 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:44.004057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7543-3005-47a8-ab56-c1b0985d9b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:44.004318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7543-3005-47a8-ab56-c1b0985d9b07 None admin] PATH_INFO: `/v3/projects/f0d69458f70b4139b4895d398502bbf4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:44.005403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7543-3005-47a8-ab56-c1b0985d9b07 None admin] RBAC: Authorizing `identity:get_project(project_id=f0d69458f70b4139b4895d398502bbf4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:44.006833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7543-3005-47a8-ab56-c1b0985d9b07 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:44.008433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 605/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:43 2022] GET /identity/v3/projects/f0d69458f70b4139b4895d398502bbf4 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:44.014449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:44.096229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:44.111386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862698c-e51a-41f5-923e-0c831f0496c6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:44.143652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bbe18-4c2e-4206-a318-142dfafcb214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:44.144842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bbe18-4c2e-4206-a318-142dfafcb214 None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:44.145114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bbe18-4c2e-4206-a318-142dfafcb214 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:44.145412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bbe18-4c2e-4206-a318-142dfafcb214 None admin] PATH_INFO: `/v3/projects/f0d69458f70b4139b4895d398502bbf4/users/cb9904e7d5c64ac39a9e64746d3fe195/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:44.147303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bbe18-4c2e-4206-a318-142dfafcb214 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0d69458f70b4139b4895d398502bbf4, user_id=cb9904e7d5c64ac39a9e64746d3fe195, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:44.148710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bbe18-4c2e-4206-a318-142dfafcb214 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:44.161339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 587/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:05:44 2022] PUT /identity/v3/projects/f0d69458f70b4139b4895d398502bbf4/users/cb9904e7d5c64ac39a9e64746d3fe195/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:05:45.999372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73892b-d350-4680-ba82-98fadc15e480 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:45.999882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73892b-d350-4680-ba82-98fadc15e480 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:45.999882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73892b-d350-4680-ba82-98fadc15e480 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.001143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 606/1193] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:46.006806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7231f-1570-4b8e-b824-fb5726492da3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:46.007208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7231f-1570-4b8e-b824-fb5726492da3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:46.007359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7231f-1570-4b8e-b824-fb5726492da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.025734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4ea7231f-1570-4b8e-b824-fb5726492da3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:46.026947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4ea7231f-1570-4b8e-b824-fb5726492da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:46.090566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 588/1194] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:05:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:05:46.359984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73892b-d350-4680-ba82-98fadc15e480 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:46.420724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:46.459275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73892b-d350-4680-ba82-98fadc15e480 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:46.492195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:46.492796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:46.493072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:46.493341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.503050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:05:46.508407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:05:46.509559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:05:46.510611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 607/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:05:46.515385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7231f-1570-4b8e-b824-fb5726492da3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:46.587345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:46.611473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7231f-1570-4b8e-b824-fb5726492da3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:46.647557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:46.648159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:46.648437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:46.648708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.649838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:46.649838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:46.651046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:46.659144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 589/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:46.665425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:46.762112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61dc13-c20b-4e2c-b6d3-20e57eddfed5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:46.784167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:46.795176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:46.795780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:46.796052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:46.796319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] PATH_INFO: `/v3/users/cb9904e7d5c64ac39a9e64746d3fe195` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.797403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] RBAC: Authorizing `identity:get_user(user_id=cb9904e7d5c64ac39a9e64746d3fe195)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:46.798848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:46.800947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 608/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 30 04:05:46 2022] GET /identity/v3/users/cb9904e7d5c64ac39a9e64746d3fe195 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:46.806866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:46.902533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab4a1-9117-4d6a-a669-e0018750f13a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:46.934680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:46.935266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:46.935543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:46.935816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.944760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:47.012525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:47.014004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:47.109963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 590/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:05:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:05:47.115909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:47.210654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca2db2-ec15-4c36-bda9-e4cd26bb7b60 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:47.242907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e411fe-db7c-401c-832f-6a48ed1c3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:47.243503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e411fe-db7c-401c-832f-6a48ed1c3106 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:47.243772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e411fe-db7c-401c-832f-6a48ed1c3106 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:47.244037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e411fe-db7c-401c-832f-6a48ed1c3106 None admin] PATH_INFO: `/v3/projects/f0d69458f70b4139b4895d398502bbf4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:47.245116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e411fe-db7c-401c-832f-6a48ed1c3106 None admin] RBAC: Authorizing `identity:get_project(project_id=f0d69458f70b4139b4895d398502bbf4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:47.246538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e411fe-db7c-401c-832f-6a48ed1c3106 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:47.248109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 609/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 30 04:05:47 2022] GET /identity/v3/projects/f0d69458f70b4139b4895d398502bbf4 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:47.254963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:47.301614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:47.369283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eba74-859f-483f-9791-c3699996e52e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:47.402718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aae52-0c4b-4d5c-b9fc-57e5b45ab179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:47.403309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aae52-0c4b-4d5c-b9fc-57e5b45ab179 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:47.403584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aae52-0c4b-4d5c-b9fc-57e5b45ab179 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:47.403852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aae52-0c4b-4d5c-b9fc-57e5b45ab179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:47.404567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aae52-0c4b-4d5c-b9fc-57e5b45ab179 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=f0d69458f70b4139b4895d398502bbf4, user.id=cb9904e7d5c64ac39a9e64746d3fe195) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:05:47.404880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aae52-0c4b-4d5c-b9fc-57e5b45ab179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:47.406316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aae52-0c4b-4d5c-b9fc-57e5b45ab179 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:47.411852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 591/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:05:47 2022] GET /identity/v3/role_assignments?user.id=cb9904e7d5c64ac39a9e64746d3fe195&scope.project.id=f0d69458f70b4139b4895d398502bbf4&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:05:57.238962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=70 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:57.409281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=49 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:42.423507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f08a3-a4ce-4f44-aab3-85f791c660ca None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:42.424173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f08a3-a4ce-4f44-aab3-85f791c660ca None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:42.424173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f08a3-a4ce-4f44-aab3-85f791c660ca None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:42.425372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 610/1201] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:42.430972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57341ffb-1fd9-40de-aa06-3a516143390c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:42.431422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57341ffb-1fd9-40de-aa06-3a516143390c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:42.431513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57341ffb-1fd9-40de-aa06-3a516143390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:42.451725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-57341ffb-1fd9-40de-aa06-3a516143390c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:42.453034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-57341ffb-1fd9-40de-aa06-3a516143390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:42.534957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 592/1202] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:06:42.805657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f08a3-a4ce-4f44-aab3-85f791c660ca None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:42.927618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f08a3-a4ce-4f44-aab3-85f791c660ca None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:42.971850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:42.972906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:42.973183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:42.973470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:42.985806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:42.987361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:06:43.003733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:43.005213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:06:43.006463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:06:43.006463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:43.006463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:06:43.014539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 611/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:43.014696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57341ffb-1fd9-40de-aa06-3a516143390c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:43.140368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57341ffb-1fd9-40de-aa06-3a516143390c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:43.181810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:43.192506 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2ac1d-844c-4341-ae3c-7d9b42e87158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:43.193132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ac1d-844c-4341-ae3c-7d9b42e87158 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:43.193413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ac1d-844c-4341-ae3c-7d9b42e87158 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:43.193738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ac1d-844c-4341-ae3c-7d9b42e87158 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:43.194384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ac1d-844c-4341-ae3c-7d9b42e87158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:43.194683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ac1d-844c-4341-ae3c-7d9b42e87158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:43.196035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ac1d-844c-4341-ae3c-7d9b42e87158 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:43.208582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 593/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:43.214864 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:43.286952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:43.340817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfac3e-b664-4262-93c3-81896e8805bd None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:43.382604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd612d34-cde9-4f08-879d-615839c466c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:43.383299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612d34-cde9-4f08-879d-615839c466c4 None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:43.383649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612d34-cde9-4f08-879d-615839c466c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:43.383970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612d34-cde9-4f08-879d-615839c466c4 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:43.384808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd612d34-cde9-4f08-879d-615839c466c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:43.387023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd612d34-cde9-4f08-879d-615839c466c4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:43.417621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 612/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 30 04:06:43 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:06:45.453687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3494d9-3b23-493d-b6fd-0ae175cc7d7a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:45.454244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3494d9-3b23-493d-b6fd-0ae175cc7d7a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:45.454437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3494d9-3b23-493d-b6fd-0ae175cc7d7a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:45.456115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 594/1206] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:06:45.461378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5ede-6727-4473-86cd-f0d1eb6e7136 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:45.461911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5ede-6727-4473-86cd-f0d1eb6e7136 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:45.461998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5ede-6727-4473-86cd-f0d1eb6e7136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:45.481460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-005e5ede-6727-4473-86cd-f0d1eb6e7136 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:45.482645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-005e5ede-6727-4473-86cd-f0d1eb6e7136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:45.559599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 613/1207] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:06:45.833720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3494d9-3b23-493d-b6fd-0ae175cc7d7a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:45.966624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3494d9-3b23-493d-b6fd-0ae175cc7d7a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:46.006901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:46.007528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:46.007838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:46.008143 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:46.019936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:06:46.024797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:46.026393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:46.027262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 595/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:06:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:46.033149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e5ede-6727-4473-86cd-f0d1eb6e7136 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:46.079949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:46.154039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e5ede-6727-4473-86cd-f0d1eb6e7136 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:46.194454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:46.195055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:46.195330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:46.195591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:46.196255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:46.196599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:46.198541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:46.209204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 614/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:46.214710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:46.286732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:46.363205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a83ca2-089e-470b-a53a-a1869255f623 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:46.397545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:46.398422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:46.398690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:46.398956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:46.409769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:46.411161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:06:46.425013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:46.426202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:06:46.427583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:06:46.427583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:46.427583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:46.427583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 596/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:46.432192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:46.537765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:46.543256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d8267-8f5a-40f7-a3df-677f15f1fede None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:46.586183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:46.586839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:46.587177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:46.587481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:46.588167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:46.588549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:46.590183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:46.607714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 615/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:46.609030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:46.725329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09d08-6d2a-4236-befe-90e5d4b56689 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:46.726053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:46.761876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:46.762495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:46.762767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:46.763030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:46.771233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:46.772688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:06:46.784476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:46.790812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:46.792626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 597/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:06:46.793253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:46.909869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f07a6-4f1e-4cb0-9622-e081465687c0 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:46.950310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:46.951023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:46.951386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:46.951602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:46.952547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:46.952884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:46.954349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:46.979960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 616/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 30 04:06:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:06:46.985340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:47.122771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf6500-0241-452f-a1e8-e2bbcf6ef6bf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:47.163079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:47.163764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:47.164113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:47.164411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:47.200758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:47.245995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:47.247453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:47.362957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 598/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:06:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:06:47.369050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:47.392300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:47.501902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdc5c-a3f5-4fec-8d3a-f0240e43360e None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:47.541274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:47.542030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:47.542256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:47.542437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:47.554913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:47.556352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:06:47.575214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:47.576561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:06:47.577496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:06:47.577496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:47.577496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:06:47.577496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 617/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:06:47.584496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:47.659649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:47.707012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aac8cf-2ab5-4ee8-a5e0-8cbefcdc3f66 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:47.745708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:47.746316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:47.746591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:47.746860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:47.747493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:47.747797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:47.749152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:47.760974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 599/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:47.768143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:47.849137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:47.887202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ef7e-7bc3-427c-b62f-a0fc78fc7a18 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:47.929005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:47.929659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:47.929932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:47.930197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:47.937697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:47.939124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:06:47.953905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:47.954904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:06:47.955826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 618/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:47.962362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:48.087723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cfae7-ae20-4e19-9ba5-064c2c40d988 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:48.114392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:48.127417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f238-860e-4a60-9de7-cc930f7d75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:48.128015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f238-860e-4a60-9de7-cc930f7d75fb None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:48.128286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f238-860e-4a60-9de7-cc930f7d75fb None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:48.128566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f238-860e-4a60-9de7-cc930f7d75fb None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:48.129256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f238-860e-4a60-9de7-cc930f7d75fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:48.129595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f238-860e-4a60-9de7-cc930f7d75fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:48.131104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f238-860e-4a60-9de7-cc930f7d75fb None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:48.144462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 600/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:48.151016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:48.273122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755c1aa-a709-4511-b563-fc750aa5ccac None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:48.305365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:48.313819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48913a89-7fbf-4ce7-bbed-9bc86fa8ec6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:48.314628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48913a89-7fbf-4ce7-bbed-9bc86fa8ec6c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:48.315032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48913a89-7fbf-4ce7-bbed-9bc86fa8ec6c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:48.315449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48913a89-7fbf-4ce7-bbed-9bc86fa8ec6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:48.316309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48913a89-7fbf-4ce7-bbed-9bc86fa8ec6c None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=18dabb17584f42bab408c14ef0b93858) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:48.316613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48913a89-7fbf-4ce7-bbed-9bc86fa8ec6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:48.318110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48913a89-7fbf-4ce7-bbed-9bc86fa8ec6c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:48.333536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 619/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:06:48 2022] GET /identity/v3/role_assignments?user.id=18dabb17584f42bab408c14ef0b93858&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:50.348793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479ec1-339e-4032-bda1-ba8c0f60afd7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:50.349368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479ec1-339e-4032-bda1-ba8c0f60afd7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:50.349368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d479ec1-339e-4032-bda1-ba8c0f60afd7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:50.351092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 601/1220] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:50.356193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823e04-c2a7-4b96-b816-b7dfe121c83a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:50.356598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823e04-c2a7-4b96-b816-b7dfe121c83a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:50.356803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823e04-c2a7-4b96-b816-b7dfe121c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:50.377163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cc823e04-c2a7-4b96-b816-b7dfe121c83a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:50.378375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cc823e04-c2a7-4b96-b816-b7dfe121c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:50.456365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 620/1221] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:06:50.748349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479ec1-339e-4032-bda1-ba8c0f60afd7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:50.859806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d479ec1-339e-4032-bda1-ba8c0f60afd7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:50.897810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:50.898520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:50.898894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:50.899261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:50.913228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:06:50.918537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:50.919606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:50.920493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 602/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:06:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:50.925773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc823e04-c2a7-4b96-b816-b7dfe121c83a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:51.038733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc823e04-c2a7-4b96-b816-b7dfe121c83a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:51.062335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:51.074576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:51.075174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:51.075438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:51.075698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:51.076351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] RBAC: Adding query filter params (name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:51.076645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:51.078032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:51.086282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 621/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:06:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:51.092089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:51.139631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:51.200240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb6271-54a5-40b3-85c9-703b11b05fac None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:51.236618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:51.237238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:51.237536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:51.237809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:51.248391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:51.249901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:06:51.264984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:51.266159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:06:51.267154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:06:51.267154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:51.267154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:51.267154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 603/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:51.272074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:51.381695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd059-ea28-410b-a7ef-7dfb703bd825 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:51.423732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:51.424428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:51.424714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:51.425062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:51.425768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:51.426145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:51.427636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:51.440231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 622/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:51.446010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:51.547151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:51.554073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce895b-6f96-4498-b2c6-39c5658d5fd9 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:51.592753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:51.593387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:51.593713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:51.593980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:51.601846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:51.603296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:06:51.614765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:51.615740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:51.617057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 604/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:51.622244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:51.670337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:51.728166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d0594-0a15-4663-8757-7da719084667 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:51.767618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:51.768339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:51.768651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:51.768950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:51.769774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:51.770079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:51.771712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:51.790461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 623/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 30 04:06:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:51.796354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:51.907302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8350-b2c2-4d2e-978b-1f2295e1c130 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:51.953175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:51.953914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:51.954250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:51.954524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:51.969297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:51.971277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:06:51.988392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:51.989418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:06:51.990655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:06:51.990655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:51.990655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:51.990655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 605/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:51.997239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:52.116716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a11614-28c6-4ecc-bd6e-6e3c7adaa49b None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:52.120346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:52.153124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:52.153778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:52.154052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:52.154377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:52.155065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:52.155390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:52.157118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:52.169689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 624/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:52.175628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:52.185439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:52.285175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657a413-b2a8-4d01-be2c-6743b903b73e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:52.326599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:52.327252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:52.327553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:52.327895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:52.336011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:52.337999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:06:52.351850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:52.356410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:52.358480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 606/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:52.361849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:52.471211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818abd6e-d065-4f65-9b78-1c87b72f617c None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:52.508682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366ecdf-cd50-4390-a5b5-35f9d41b201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:52.509420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ecdf-cd50-4390-a5b5-35f9d41b201c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:52.509714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ecdf-cd50-4390-a5b5-35f9d41b201c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:52.510060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ecdf-cd50-4390-a5b5-35f9d41b201c None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:52.511045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366ecdf-cd50-4390-a5b5-35f9d41b201c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:52.511354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366ecdf-cd50-4390-a5b5-35f9d41b201c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:52.513050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366ecdf-cd50-4390-a5b5-35f9d41b201c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:52.527543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 625/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:06:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:52.534288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:52.610744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:52.647981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48383f-36da-4312-9186-0831bd09428a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:52.704076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aca17-cf85-477c-9e6e-8c25d82255db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:52.704737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aca17-cf85-477c-9e6e-8c25d82255db None admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:52.705010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aca17-cf85-477c-9e6e-8c25d82255db None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:52.705282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aca17-cf85-477c-9e6e-8c25d82255db None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/18dabb17584f42bab408c14ef0b93858/roles/d58aba80ce4142dfade37664a1f81d8f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:52.720907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aca17-cf85-477c-9e6e-8c25d82255db None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=18dabb17584f42bab408c14ef0b93858, role_id=d58aba80ce4142dfade37664a1f81d8f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:52.722369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aca17-cf85-477c-9e6e-8c25d82255db None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:52.735800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 607/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:06:52 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/18dabb17584f42bab408c14ef0b93858/roles/d58aba80ce4142dfade37664a1f81d8f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:06:54.952146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d6d8-1f00-44ce-8b83-8ead5d5917c0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:54.952674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d6d8-1f00-44ce-8b83-8ead5d5917c0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:54.952674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d6d8-1f00-44ce-8b83-8ead5d5917c0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:54.954396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 626/1233] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:54.962021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0b4e-e819-411c-a8ea-7d7cc1c79ded None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:54.962983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0b4e-e819-411c-a8ea-7d7cc1c79ded None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:54.963087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f0b4e-e819-411c-a8ea-7d7cc1c79ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:54.982198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f52f0b4e-e819-411c-a8ea-7d7cc1c79ded None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:54.983596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f52f0b4e-e819-411c-a8ea-7d7cc1c79ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:55.052803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 608/1234] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:06:55.318565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d6d8-1f00-44ce-8b83-8ead5d5917c0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:55.345593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:55.434690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d6d8-1f00-44ce-8b83-8ead5d5917c0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:55.474471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:55.475278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:55.475585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:55.475988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:55.486921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:06:55.491642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:55.492629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:06:55.494524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 627/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 30 04:06:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:55.498934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f0b4e-e819-411c-a8ea-7d7cc1c79ded None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:55.548251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:55.604296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f0b4e-e819-411c-a8ea-7d7cc1c79ded None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:55.640659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:55.641264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:55.641572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:55.641839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:55.642501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] RBAC: Adding query filter params (name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:55.642817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:55.644156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:55.652704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 609/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 30 04:06:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:55.659247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:55.755560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:55.775809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20db63-00f5-435d-bd76-b2c386af1eaa None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:55.812951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:55.813624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:55.813900 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:55.814166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:55.827793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:55.829226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:06:55.843540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:55.844700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:06:55.845901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:06:55.845901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:55.845901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:06:55.845901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 628/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:55.850587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:55.973330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df6731-3fb5-436b-8b0d-d58b319c7adf None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:55.993139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:56.037534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:56.037534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:56.037534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:56.037534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:56.038023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:56.038023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:56.038023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:56.057569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 610/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:56.058826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:56.167961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ac5d4-df0d-4a18-a0a2-5179a13ee900 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:56.204050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:56.204680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:56.204951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:56.205215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:56.208445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:56.215060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:56.216899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:06:56.228872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:56.230067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:06:56.231233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 629/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:56.236232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:56.346120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e310372-ffbb-4f87-bedd-cf90a779dd8e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:56.383482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:56.384715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:56.384987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:56.385262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:56.386051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:56.386352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:56.387781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:56.404922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 611/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 30 04:06:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:56.412126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:56.526475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40c0f-ee48-4b0a-8a66-bcda748dd964 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:56.564296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:56.565203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:56.565691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:56.566023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:56.643638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:56.650818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:56.652259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:56.755370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 630/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:06:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:06:56.761783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:56.790492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:56.869129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ef4c9-a1f6-4cfe-9590-593ad03a26d5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:56.906452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:56.907078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:56.907353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:56.907632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:56.917994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:56.919468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:06:56.933961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:56.934950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:06:56.936331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:06:56.936331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:06:56.936331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:56.936331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 612/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:06:56.941166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:57.055771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:57.062967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5456-1599-4352-99a6-94878bc49c95 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:57.100148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:57.100826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:57.101171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:57.101445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:57.102203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:57.102548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:57.104121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:57.116840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 631/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:57.123846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:57.211897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:57.236855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8fcc1-9e60-46a3-bcfa-4870818b0bf1 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:57.274778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:57.275408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:57.275682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:57.275950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:57.283210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:57.284904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:06:57.296678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:06:57.297668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:06:57.298962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 613/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:06:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:06:57.304175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:57.414998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d5b7f-79e7-4ef2-974a-3dd6ca777cbc None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:57.454079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa78586-67f6-4653-a28e-22323d8266e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:57.454865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78586-67f6-4653-a28e-22323d8266e4 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:57.455070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78586-67f6-4653-a28e-22323d8266e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:57.455324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78586-67f6-4653-a28e-22323d8266e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:57.456039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa78586-67f6-4653-a28e-22323d8266e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:57.456438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa78586-67f6-4653-a28e-22323d8266e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:57.458131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa78586-67f6-4653-a28e-22323d8266e4 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:57.477492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 632/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:06:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:57.479395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:57.589346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711ead-57bb-4e20-a572-5c5018ab186d None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:57.629308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088a0fb-2456-43b2-ba4e-0e1a393ff869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:57.630050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a0fb-2456-43b2-ba4e-0e1a393ff869 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:57.630333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a0fb-2456-43b2-ba4e-0e1a393ff869 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:57.630618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a0fb-2456-43b2-ba4e-0e1a393ff869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:57.631436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a0fb-2456-43b2-ba4e-0e1a393ff869 None admin] RBAC: Adding query filter params (role.id=d58aba80ce4142dfade37664a1f81d8f, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=18dabb17584f42bab408c14ef0b93858) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:06:57.631775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a0fb-2456-43b2-ba4e-0e1a393ff869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:57.633482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088a0fb-2456-43b2-ba4e-0e1a393ff869 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:57.640278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 614/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:06:57 2022] GET /identity/v3/role_assignments?user.id=18dabb17584f42bab408c14ef0b93858&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=d58aba80ce4142dfade37664a1f81d8f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:06:59.605271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310f30-e194-456f-a59e-88af348f0136 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:59.605978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310f30-e194-456f-a59e-88af348f0136 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:59.605978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310f30-e194-456f-a59e-88af348f0136 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:59.607427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 633/1247] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:59.612560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c880f83-2af4-4203-be9b-76de2e74e933 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:59.612994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c880f83-2af4-4203-be9b-76de2e74e933 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:59.613084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c880f83-2af4-4203-be9b-76de2e74e933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:59.619475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:59.632095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8c880f83-2af4-4203-be9b-76de2e74e933 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:59.633282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8c880f83-2af4-4203-be9b-76de2e74e933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:59.704182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 615/1248] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:06:59.978527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310f30-e194-456f-a59e-88af348f0136 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:00.000757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:00.111144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310f30-e194-456f-a59e-88af348f0136 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:00.146820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:00.147448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:00.147729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:00.148003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:00.159949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:07:00.165972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:00.167181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:00.168420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 634/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:00.173754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c880f83-2af4-4203-be9b-76de2e74e933 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:00.287486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c880f83-2af4-4203-be9b-76de2e74e933 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:00.319781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:00.325352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:00.326004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:00.326259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:00.326528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:00.327181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:00.327497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:00.328805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:00.338785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 616/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:07:00.345661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:00.435567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:00.472162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e903c0-b7a5-4e6e-9657-f0d9b9643fa5 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:00.511504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:00.512137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:00.512458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:00.512767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:00.525153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:00.527074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:07:00.543690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:00.544776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:07:00.545815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:07:00.545815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:00.545815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:00.545815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 635/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:00.551379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:00.667363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95392be1-e74a-4e3d-9d9a-a363bad2e218 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:00.706276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:00.707343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:00.707659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:00.707933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:00.708672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:00.709227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:00.710685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:00.724795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 617/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:00.730472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:00.844315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb825c70-928d-4760-beeb-3a04f390695f None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:00.873762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:00.883159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:00.884412 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:00.884692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:00.884959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:00.893591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:00.895183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:07:00.908377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:00.909619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:00.910600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 636/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:00.916270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:00.979461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:01.032955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131c4e1-ade0-46c9-b6d6-67dc15616d4a None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:01.073096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:01.073938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:01.074326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:01.074825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:01.075759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:01.076162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:01.078566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:01.106924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 618/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 30 04:07:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:01.112983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:01.234559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da56615-01a6-4b5a-965f-b3ad9870e1d1 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:01.273486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:01.274108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:01.274982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:01.275252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:01.332177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:01.347810 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:01.349235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:01.467417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 637/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:07:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:07:01.468634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:01.600394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdc5ab-ddd0-471b-9ebb-ecdc505e9c09 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:01.619230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:01.643623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:01.644249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:01.644524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:01.644790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:01.658496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:01.659970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:07:01.677733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:01.679483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:07:01.681137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:07:01.681137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:01.681137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:01.681137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 619/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:07:01.687799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:01.782035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:01.799077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0064-c9db-4a02-ba78-b937237e5893 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:01.837523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:01.838149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:01.838426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:01.838696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:01.839341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:01.839640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:01.841068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:01.854573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 638/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:01.860659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:01.996318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ab1d8-deee-4f03-aaac-5ebce3990e18 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:02.033745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:02.034284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:02.034553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:02.034816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:02.041319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:02.042811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:07:02.053779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:02.054871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:02.061395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 620/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:02.061944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:02.177535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5affa1-59a1-4202-a1f2-4c9167c88be7 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:02.217325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec8664-76c1-4687-b9c7-be008a7031b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:02.217956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec8664-76c1-4687-b9c7-be008a7031b2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:02.218235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec8664-76c1-4687-b9c7-be008a7031b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:02.218506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec8664-76c1-4687-b9c7-be008a7031b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:02.219190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec8664-76c1-4687-b9c7-be008a7031b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:02.219494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec8664-76c1-4687-b9c7-be008a7031b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:02.220952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec8664-76c1-4687-b9c7-be008a7031b2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:02.232806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 639/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:07:02.238940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:02.266192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:02.351626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14379156-3be0-45bd-b2f1-82de310aa2cd None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:02.395160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bb509-df33-4e98-b116-89f305e92a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:02.395824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb509-df33-4e98-b116-89f305e92a1d None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:02.396319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb509-df33-4e98-b116-89f305e92a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:02.396734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bb509-df33-4e98-b116-89f305e92a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:02.397955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bb509-df33-4e98-b116-89f305e92a1d None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=18dabb17584f42bab408c14ef0b93858) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:02.398270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bb509-df33-4e98-b116-89f305e92a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:02.400246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bb509-df33-4e98-b116-89f305e92a1d None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:02.405683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 621/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:07:02 2022] GET /identity/v3/role_assignments?user.id=18dabb17584f42bab408c14ef0b93858&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=108991f8e3774559b4def1c3448e020b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:04.290558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48200-02c7-4d28-8c68-90910b3e9e52 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:04.291117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48200-02c7-4d28-8c68-90910b3e9e52 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:04.291117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48200-02c7-4d28-8c68-90910b3e9e52 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:04.292429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 640/1261] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:04.297364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efd64-3def-43f1-9d4f-0349a9f25ca5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:04.297827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efd64-3def-43f1-9d4f-0349a9f25ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:04.297974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911efd64-3def-43f1-9d4f-0349a9f25ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:04.316362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-911efd64-3def-43f1-9d4f-0349a9f25ca5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:04.317574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-911efd64-3def-43f1-9d4f-0349a9f25ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:04.381975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 622/1262] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:07:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:07:04.648143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48200-02c7-4d28-8c68-90910b3e9e52 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:04.659448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:04.748639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48200-02c7-4d28-8c68-90910b3e9e52 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:04.780821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:04.781422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:04.781721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:04.781988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:04.792124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:07:04.796916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:04.798068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:04.799278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 641/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:07:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:04.803838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efd64-3def-43f1-9d4f-0349a9f25ca5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:04.821618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:04.909122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911efd64-3def-43f1-9d4f-0349a9f25ca5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:04.941371 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:04.941989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:04.942263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:04.942530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:04.943191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:04.943491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:04.944842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:04.953437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 623/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:04.959426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:05.029248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:05.061087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6499-c6de-492e-bf54-af08d01dbc87 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:05.094142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:05.094750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:05.095029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:05.095297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:05.104838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:05.106337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:07:05.120253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:05.121994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:07:05.123341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:07:05.123341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:05.123341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:05.123341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 642/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:05.128076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:05.208326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:05.227988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5bfaf-26a4-4ce1-b64f-a9cb86e9b696 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:05.260104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:05.260695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:05.260967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:05.261259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:05.261887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:05.262185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:05.263611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:05.275525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 624/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:05.281196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:05.376673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05374-8880-45bf-bf51-a0d0f4d9d689 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:05.395623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:05.409255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:05.409888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:05.410161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:05.410425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:05.417651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:05.419041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:07:05.429612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:05.431301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:05.432497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 643/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:05.436881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:05.561360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8db58-08c6-4d77-953b-601f63e8957c None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:05.595136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:05.595740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:05.596016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:05.596282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:05.597000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:05.597300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:05.598755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:05.607310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:05.615653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 625/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 30 04:07:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:05.621908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:05.718934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abc5aa-d9b6-4372-90c5-08888a5b83ca None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:05.751624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:05.752223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:05.752498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:05.752765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:05.762913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:05.764335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:07:05.777985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:05.779081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:07:05.780390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:07:05.780390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:05.780390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:05.780390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 644/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:05.784707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:05.887105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c590a-9cd3-478e-8d4c-d317a15da237 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:05.920103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:05.920697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:05.920975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:05.921245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:05.921904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:05.922205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:05.923560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:05.935012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 626/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:05.940668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:05.976811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:06.046044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba3d1f-db47-4ae9-a5eb-65d4443288d6 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:06.078989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:06.079602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:06.079879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:06.080146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:06.086858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:06.088276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:07:06.099194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:06.100323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:06.101541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 645/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:06.106204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:06.163212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:06.204052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a51cf-9619-4b87-a45f-c4b068585310 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:06.236030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019c7b8-18f6-46e1-9ab0-43eeddb578e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:06.236621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c7b8-18f6-46e1-9ab0-43eeddb578e7 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:06.236897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c7b8-18f6-46e1-9ab0-43eeddb578e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:06.237167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019c7b8-18f6-46e1-9ab0-43eeddb578e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:06.237876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019c7b8-18f6-46e1-9ab0-43eeddb578e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:06.238178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019c7b8-18f6-46e1-9ab0-43eeddb578e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:06.239584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019c7b8-18f6-46e1-9ab0-43eeddb578e7 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:06.251571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 627/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:06.257593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:06.345610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:06.355343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4379d-bd62-43c7-97e1-e03292e1c520 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:06.387400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e29d9-5212-4021-8621-dc211130fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:06.388056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e29d9-5212-4021-8621-dc211130fc6b None admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:06.388333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e29d9-5212-4021-8621-dc211130fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:06.388601 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e29d9-5212-4021-8621-dc211130fc6b None admin] PATH_INFO: `/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/18dabb17584f42bab408c14ef0b93858/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:06.390538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e29d9-5212-4021-8621-dc211130fc6b None admin] RBAC: Authorizing `identity:create_grant(project_id=65ad8fe9e8804d01bceafd4494b05952, user_id=18dabb17584f42bab408c14ef0b93858, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:06.391949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e29d9-5212-4021-8621-dc211130fc6b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:06.404745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 646/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 30 04:07:06 2022] PUT /identity/v3/projects/65ad8fe9e8804d01bceafd4494b05952/users/18dabb17584f42bab408c14ef0b93858/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:07:08.283066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe89090-34b5-4b0b-b927-600def105227 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:08.283613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe89090-34b5-4b0b-b927-600def105227 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:08.283613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe89090-34b5-4b0b-b927-600def105227 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:08.284947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 628/1274] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:08.290759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f090b6-b265-4553-be6b-bf98bb7f5adc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:08.291141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f090b6-b265-4553-be6b-bf98bb7f5adc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:08.291293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f090b6-b265-4553-be6b-bf98bb7f5adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:08.308898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-87f090b6-b265-4553-be6b-bf98bb7f5adc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:08.310095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-87f090b6-b265-4553-be6b-bf98bb7f5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:08.373359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 647/1275] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:07:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:07:08.644358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe89090-34b5-4b0b-b927-600def105227 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:08.741199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe89090-34b5-4b0b-b927-600def105227 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:08.757496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:08.774746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:08.775345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:08.775615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:08.775879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:08.785461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:07:08.791472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:08.792615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:08.793496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 629/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 30 04:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:08.798701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f090b6-b265-4553-be6b-bf98bb7f5adc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:08.884731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:08.903547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f090b6-b265-4553-be6b-bf98bb7f5adc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:08.935222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:08.935807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:08.936078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:08.936340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:08.936988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:08.937279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:08.938648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:08.946941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 648/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 30 04:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:08.953086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:09.056780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10785d-0c63-4fd4-814a-bdfd0995cf21 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:09.090348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:09.090954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:09.091224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:09.091487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:09.101477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:09.102915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:07:09.116323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:09.117966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:07:09.119252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:07:09.119252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:09.119252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:09.119252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 630/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:07:09.123765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:09.223109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60178b9-6853-4c0e-9762-b02103494fef None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:09.255042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:09.255631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:09.255908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:09.256177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:09.256803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:09.257101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:09.259067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:09.270335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 649/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:09.275995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:09.306119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:09.372488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729dc50-036b-4901-af49-e0c5163bd3cc None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:09.404567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:09.405170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:09.405442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:09.405738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:09.412806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:09.414776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:07:09.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:09.426587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:09.427571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 631/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:09.433093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:09.436779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:09.528463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc808f8-b18f-4858-8798-7c11a1e84645 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:09.561240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:09.561851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:09.562122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:09.562384 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:09.563083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:09.563377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:09.564766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:09.580953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 650/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 30 04:07:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:09.587047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:09.674443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:09.684849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df037af-a9d2-471b-91fc-ade9fc12823e None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:09.717041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:09.717650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:09.717926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:09.718192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:09.782517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:09.783875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:09.873569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:09.884284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 632/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 30 04:07:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:07:09.890056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:09.948349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:09.991331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791d245-b7b1-4bb5-ac18-fa4cb169e336 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:10.024038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:10.024643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:10.024919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:10.025184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:10.034825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:10.036177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:07:10.050756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:10.051856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:07:10.052777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:07:10.052777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:07:10.052777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:10.052777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 651/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:10.057782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:10.153227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34728a1e-4a10-4b2e-a9d9-7d1c2d7fc8ae None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:10.185711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:10.186294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:10.186565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:10.186828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:10.187456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:10.187749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:10.189087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:10.200316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 633/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 30 04:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:10.205879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:10.301127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94df30-9258-4358-8132-b3a6a2934f35 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:10.314104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:10.334606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:10.335203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:10.335476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:10.335741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:10.342774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:10.344174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:07:10.355034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:10.356074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: ERROR keystone.server.flask.application Aug 30 04:07:10.357191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 652/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 30 04:07:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:10.362153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:10.410494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:10.457528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da8e2a-0964-446a-9dab-5623edadb9d6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:10.489873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691f0c-9c56-465d-b682-3e9dc5ebb82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:10.490457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691f0c-9c56-465d-b682-3e9dc5ebb82c None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:10.490727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691f0c-9c56-465d-b682-3e9dc5ebb82c None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:10.490991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691f0c-9c56-465d-b682-3e9dc5ebb82c None admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:10.491661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8691f0c-9c56-465d-b682-3e9dc5ebb82c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:10.491959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8691f0c-9c56-465d-b682-3e9dc5ebb82c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:10.493393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8691f0c-9c56-465d-b682-3e9dc5ebb82c None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:10.504769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 634/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 30 04:07:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:10.511267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:10.608693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7574e-14c4-4057-860d-03c5589e37ca None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:10.641485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d9e77-8d14-4c72-8914-b7c12fafa0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:10.642094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d9e77-8d14-4c72-8914-b7c12fafa0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:10.642368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d9e77-8d14-4c72-8914-b7c12fafa0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:10.642634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d9e77-8d14-4c72-8914-b7c12fafa0f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:10.643340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d9e77-8d14-4c72-8914-b7c12fafa0f2 None admin] RBAC: Adding query filter params (role.id=108991f8e3774559b4def1c3448e020b, scope.project.id=65ad8fe9e8804d01bceafd4494b05952, user.id=18dabb17584f42bab408c14ef0b93858) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:10.643643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d9e77-8d14-4c72-8914-b7c12fafa0f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:10.645033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d9e77-8d14-4c72-8914-b7c12fafa0f2 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:10.650709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 653/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 30 04:07:10 2022] GET /identity/v3/role_assignments?user.id=18dabb17584f42bab408c14ef0b93858&scope.project.id=65ad8fe9e8804d01bceafd4494b05952&role.id=108991f8e3774559b4def1c3448e020b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:12.610164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c6b8-b431-477a-b3bc-659adb8480f1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:12.610620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c6b8-b431-477a-b3bc-659adb8480f1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:12.610712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c6b8-b431-477a-b3bc-659adb8480f1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:12.612022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 635/1288] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:12.617316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7d83-6f4e-40bc-bd6b-f3e6849b9548 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:12.617787 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7d83-6f4e-40bc-bd6b-f3e6849b9548 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:12.617881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda7d83-6f4e-40bc-bd6b-f3e6849b9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:12.636191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6cda7d83-6f4e-40bc-bd6b-f3e6849b9548 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:12.637484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6cda7d83-6f4e-40bc-bd6b-f3e6849b9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:12.666203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:12.703470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 654/1289] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:07:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:07:12.968763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c6b8-b431-477a-b3bc-659adb8480f1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:13.080564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c6b8-b431-477a-b3bc-659adb8480f1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:13.091245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:13.114578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:13.115190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:13.115468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:13.115737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:13.116311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:13.118192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:13.126823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:13.128019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:13.128893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 636/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:07:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:13.134672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7d83-6f4e-40bc-bd6b-f3e6849b9548 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:13.228645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda7d83-6f4e-40bc-bd6b-f3e6849b9548 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:13.260948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205ffaf-e798-429b-a7a0-49a961a2967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:13.261553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ffaf-e798-429b-a7a0-49a961a2967c None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:13.261830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ffaf-e798-429b-a7a0-49a961a2967c None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:13.262100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205ffaf-e798-429b-a7a0-49a961a2967c None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:13.262716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ffaf-e798-429b-a7a0-49a961a2967c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:13.263012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ffaf-e798-429b-a7a0-49a961a2967c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:13.264361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205ffaf-e798-429b-a7a0-49a961a2967c None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:13.268952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 655/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 30 04:07:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:13.274456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:13.370653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a381-e0e8-4f5c-8f0d-b3e2d1b362e6 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:13.403104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a361d-6bf7-4afa-9b79-6e639ba84b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:13.403690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a361d-6bf7-4afa-9b79-6e639ba84b15 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:13.403962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a361d-6bf7-4afa-9b79-6e639ba84b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:13.404226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a361d-6bf7-4afa-9b79-6e639ba84b15 None admin] PATH_INFO: `/v3/services` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:13.404834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a361d-6bf7-4afa-9b79-6e639ba84b15 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:13.405129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a361d-6bf7-4afa-9b79-6e639ba84b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:13.406489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a361d-6bf7-4afa-9b79-6e639ba84b15 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:13.410718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 637/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 30 04:07:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:15.294165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840862c-2ca3-4cd6-a5b8-908ff0af7f5c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:15.294724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840862c-2ca3-4cd6-a5b8-908ff0af7f5c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:15.294724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840862c-2ca3-4cd6-a5b8-908ff0af7f5c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:15.296040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 656/1293] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:15.301131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7833f-545b-4b90-92eb-ee5d570dc19b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:15.301539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7833f-545b-4b90-92eb-ee5d570dc19b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:15.301704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7833f-545b-4b90-92eb-ee5d570dc19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:15.319496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-73a7833f-545b-4b90-92eb-ee5d570dc19b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:15.320677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-73a7833f-545b-4b90-92eb-ee5d570dc19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:15.349859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:15.386692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 638/1294] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:07:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:07:15.657162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840862c-2ca3-4cd6-a5b8-908ff0af7f5c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:15.687109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:15.755695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840862c-2ca3-4cd6-a5b8-908ff0af7f5c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:15.788839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ba5b1-100b-4a33-b1ac-467da943bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:15.789423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba5b1-100b-4a33-b1ac-467da943bb4b None admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:15.789757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba5b1-100b-4a33-b1ac-467da943bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:15.790030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba5b1-100b-4a33-b1ac-467da943bb4b None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:15.790678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ba5b1-100b-4a33-b1ac-467da943bb4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:15.792001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ba5b1-100b-4a33-b1ac-467da943bb4b None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:15.806084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 657/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 30 04:07:15 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:07:17.700960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9efec9-c3a6-4c0e-ad91-e61e4aedb630 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:17.701472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9efec9-c3a6-4c0e-ad91-e61e4aedb630 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:17.701472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9efec9-c3a6-4c0e-ad91-e61e4aedb630 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:17.702866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 639/1296] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:17.708253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c959-796a-476e-b6b1-37c126f33ea0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:17.708662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c959-796a-476e-b6b1-37c126f33ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:17.708788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c959-796a-476e-b6b1-37c126f33ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:17.727196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2679c959-796a-476e-b6b1-37c126f33ea0 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:17.728364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2679c959-796a-476e-b6b1-37c126f33ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:17.797894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 658/1297] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:07:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:07:18.067295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9efec9-c3a6-4c0e-ad91-e61e4aedb630 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:18.175391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9efec9-c3a6-4c0e-ad91-e61e4aedb630 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:18.208771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:18.209380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:18.209686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:18.209953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:18.210519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:18.211871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:18.220322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:18.221502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:18.222412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 640/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:07:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:18.227688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c959-796a-476e-b6b1-37c126f33ea0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:18.245784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:18.323475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c959-796a-476e-b6b1-37c126f33ea0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:18.355171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:18.355749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:18.356018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:18.356279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:18.356891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:18.357182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:18.358536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:18.363386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 659/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 30 04:07:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:18.369738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:18.401844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:18.467954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d421b-da06-4d3f-b42f-2bff71acf4b5 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:18.500459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37247d85-5bea-4eeb-9838-f4f5ccb79d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:18.501038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37247d85-5bea-4eeb-9838-f4f5ccb79d95 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:18.501313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37247d85-5bea-4eeb-9838-f4f5ccb79d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:18.501608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37247d85-5bea-4eeb-9838-f4f5ccb79d95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:18.502294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37247d85-5bea-4eeb-9838-f4f5ccb79d95 None admin] RBAC: Adding query filter params (interface=public, service_id=c63bfa78aa3640b9b499233089971c8d, region_id=RegionOne) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:18.502593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37247d85-5bea-4eeb-9838-f4f5ccb79d95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:18.503930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37247d85-5bea-4eeb-9838-f4f5ccb79d95 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:18.508751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 641/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 30 04:07:18 2022] GET /identity/v3/endpoints?service_id=c63bfa78aa3640b9b499233089971c8d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:07:18.514449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:18.593052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:18.611609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6a3e3-028f-4fc2-a594-162333c030f9 None admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:18.646120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce75d54-c924-49f6-ba03-ce27200ca962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:18.646719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75d54-c924-49f6-ba03-ce27200ca962 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:18.646992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75d54-c924-49f6-ba03-ce27200ca962 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:18.647255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce75d54-c924-49f6-ba03-ce27200ca962 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:18.648005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce75d54-c924-49f6-ba03-ce27200ca962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:18.649351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce75d54-c924-49f6-ba03-ce27200ca962 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:18.656002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 660/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 30 04:07:18 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:07:20.509570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94efc-9765-4c91-9f25-b931751361c0 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:20.510098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94efc-9765-4c91-9f25-b931751361c0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:20.510098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94efc-9765-4c91-9f25-b931751361c0 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:20.511537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 642/1302] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:20.516788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215818-3089-4a2a-bfb3-f4d0dc2e4c9a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:20.517198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215818-3089-4a2a-bfb3-f4d0dc2e4c9a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:20.517333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215818-3089-4a2a-bfb3-f4d0dc2e4c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:20.535575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cc215818-3089-4a2a-bfb3-f4d0dc2e4c9a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:20.536756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cc215818-3089-4a2a-bfb3-f4d0dc2e4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:20.619791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 661/1303] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:07:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:07:20.885021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94efc-9765-4c91-9f25-b931751361c0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:20.984364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:20.991412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94efc-9765-4c91-9f25-b931751361c0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:21.024274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:21.024919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:21.025195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:21.025464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:21.026070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:21.027418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:07:21.035977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:07:21.037164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application with Lock( Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: ERROR keystone.server.flask.application Aug 30 04:07:21.038293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 643/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 30 04:07:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:07:21.043040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc215818-3089-4a2a-bfb3-f4d0dc2e4c9a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:21.114910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:21.138335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc215818-3089-4a2a-bfb3-f4d0dc2e4c9a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:21.169772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0147a2-06f1-4681-8fc1-ede0defcf8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:21.170348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0147a2-06f1-4681-8fc1-ede0defcf8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:21.170617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0147a2-06f1-4681-8fc1-ede0defcf8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:21.170880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0147a2-06f1-4681-8fc1-ede0defcf8c0 None admin] PATH_INFO: `/v3/services` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:21.171489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0147a2-06f1-4681-8fc1-ede0defcf8c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:21.171807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0147a2-06f1-4681-8fc1-ede0defcf8c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:21.173166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0147a2-06f1-4681-8fc1-ede0defcf8c0 None admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:21.178029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 662/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 30 04:07:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:21.184502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:21.281206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c79ed-0ebb-4664-a87a-8c4e16a55b47 None admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:21.313625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f78c3e-ff6f-409d-bad6-47f815784ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:21.314212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f78c3e-ff6f-409d-bad6-47f815784ef0 None admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:21.314485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f78c3e-ff6f-409d-bad6-47f815784ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:21.314751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f78c3e-ff6f-409d-bad6-47f815784ef0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:21.315406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f78c3e-ff6f-409d-bad6-47f815784ef0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:21.316751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f78c3e-ff6f-409d-bad6-47f815784ef0 None admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:21.335698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 644/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:07:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:07:31.175608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=30 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:31.330771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:24.903447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65034d-6da4-4106-b44a-3d29afff704e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:24.904005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65034d-6da4-4106-b44a-3d29afff704e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:24.904005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65034d-6da4-4106-b44a-3d29afff704e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:24.910802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662975e-663d-4fea-87a2-88965967a6df None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:24.911228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662975e-663d-4fea-87a2-88965967a6df None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:24.911323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662975e-663d-4fea-87a2-88965967a6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:24.916148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 663/1307] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:24.988847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b662975e-663d-4fea-87a2-88965967a6df None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:24.990162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b662975e-663d-4fea-87a2-88965967a6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:25.098516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 645/1308] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:08:25.389684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228ddc-7978-48f1-9920-3d2dd9a60494 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:25.389965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228ddc-7978-48f1-9920-3d2dd9a60494 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:25.390234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228ddc-7978-48f1-9920-3d2dd9a60494 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:25.391580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 664/1309] 10.222.0.69 () {54 vars in 965 bytes} [Tue Aug 30 04:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:25.398419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567231d5-6f16-4382-b832-fcc2001cf24f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:25.398703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567231d5-6f16-4382-b832-fcc2001cf24f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:25.398998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567231d5-6f16-4382-b832-fcc2001cf24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:25.488124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-567231d5-6f16-4382-b832-fcc2001cf24f None None] MFA Rules not processed for user `f520107f73aa48f791461922a3d6ec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:25.489527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-567231d5-6f16-4382-b832-fcc2001cf24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:25.512735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:25.572337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 646/1310] 10.222.0.69 () {58 vars in 1062 bytes} [Tue Aug 30 04:08:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:25.581345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55228ddc-7978-48f1-9920-3d2dd9a60494 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:25.583188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-55228ddc-7978-48f1-9920-3d2dd9a60494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:25.701490 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55228ddc-7978-48f1-9920-3d2dd9a60494 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:25.778275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d18ed-3c9a-45c5-84ad-64eaf2e5ad80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:25.778791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d18ed-3c9a-45c5-84ad-64eaf2e5ad80 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:25.779064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d18ed-3c9a-45c5-84ad-64eaf2e5ad80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:25.779334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d18ed-3c9a-45c5-84ad-64eaf2e5ad80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:25.780934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-254d18ed-3c9a-45c5-84ad-64eaf2e5ad80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:25.858836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:25.918210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d18ed-3c9a-45c5-84ad-64eaf2e5ad80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:25.919632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d18ed-3c9a-45c5-84ad-64eaf2e5ad80 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:25.939419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 665/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:28.129399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4177a-dad2-4264-9ef6-70ed3bcefb09 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:28.129955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4177a-dad2-4264-9ef6-70ed3bcefb09 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:28.129955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4177a-dad2-4264-9ef6-70ed3bcefb09 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:28.131242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 647/1312] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:08:28.136541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d447-6c71-4161-ab0e-7983035040ae None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:28.136951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d447-6c71-4161-ab0e-7983035040ae None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:28.137080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7d447-6c71-4161-ab0e-7983035040ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:28.217347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7fa7d447-6c71-4161-ab0e-7983035040ae None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:28.218579 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7fa7d447-6c71-4161-ab0e-7983035040ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:28.312219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 666/1313] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:28.591999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4177a-dad2-4264-9ef6-70ed3bcefb09 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:28.593613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-79f4177a-dad2-4264-9ef6-70ed3bcefb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:28.697784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4177a-dad2-4264-9ef6-70ed3bcefb09 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:28.770444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:28.774117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32d64b-9207-4088-b96b-427f87826d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:28.774723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32d64b-9207-4088-b96b-427f87826d80 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:28.774995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32d64b-9207-4088-b96b-427f87826d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:28.775262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32d64b-9207-4088-b96b-427f87826d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:28.776886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5f32d64b-9207-4088-b96b-427f87826d80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:28.887450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32d64b-9207-4088-b96b-427f87826d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:28.888881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32d64b-9207-4088-b96b-427f87826d80 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:28.907952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 648/1314] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:31.104052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a322-b8d7-46fd-9e6c-d264154551fc None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:31.104608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a322-b8d7-46fd-9e6c-d264154551fc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:31.104608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a322-b8d7-46fd-9e6c-d264154551fc None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:31.106001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 667/1315] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:31.111046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fc7d-3a43-4f62-a813-2073910d97c5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:31.111492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fc7d-3a43-4f62-a813-2073910d97c5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:31.111587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fc7d-3a43-4f62-a813-2073910d97c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:31.177889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c796fc7d-3a43-4f62-a813-2073910d97c5 None None] MFA Rules not processed for user `a68b15b13af94675b3fa8fc734f85006`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:31.179072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c796fc7d-3a43-4f62-a813-2073910d97c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:31.230108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:31.274910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 649/1316] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:31.554269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a322-b8d7-46fd-9e6c-d264154551fc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:31.555849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9640a322-b8d7-46fd-9e6c-d264154551fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:31.565447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:31.658915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a322-b8d7-46fd-9e6c-d264154551fc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:31.729401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0e3c-b56b-4d07-a5ae-7219ef617c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:31.730014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0e3c-b56b-4d07-a5ae-7219ef617c25 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:31.730286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0e3c-b56b-4d07-a5ae-7219ef617c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:31.730549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0e3c-b56b-4d07-a5ae-7219ef617c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:31.732112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-16df0e3c-b56b-4d07-a5ae-7219ef617c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:31.791265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:31.836576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0e3c-b56b-4d07-a5ae-7219ef617c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:31.838019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0e3c-b56b-4d07-a5ae-7219ef617c25 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:31.857589 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 668/1317] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:34.289387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8c2d-48d9-4142-9d54-88f431403c0e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:34.289982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8c2d-48d9-4142-9d54-88f431403c0e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:34.289982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e8c2d-48d9-4142-9d54-88f431403c0e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:34.291282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 650/1318] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:34.296300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84242a-5b2c-42ef-85c3-bf2f0e1f487e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:34.296691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84242a-5b2c-42ef-85c3-bf2f0e1f487e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:34.296848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84242a-5b2c-42ef-85c3-bf2f0e1f487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:34.362232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-db84242a-5b2c-42ef-85c3-bf2f0e1f487e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:34.363995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-db84242a-5b2c-42ef-85c3-bf2f0e1f487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:34.456512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 669/1319] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:34.740359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8c2d-48d9-4142-9d54-88f431403c0e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:34.741937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-eb9e8c2d-48d9-4142-9d54-88f431403c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:34.842823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e8c2d-48d9-4142-9d54-88f431403c0e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:34.915308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f31bd9-7803-4aec-a79e-6e8ca5f00a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:34.915902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f31bd9-7803-4aec-a79e-6e8ca5f00a4b service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:34.916172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f31bd9-7803-4aec-a79e-6e8ca5f00a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:34.916439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f31bd9-7803-4aec-a79e-6e8ca5f00a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:34.918026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-68f31bd9-7803-4aec-a79e-6e8ca5f00a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:34.925315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:35.030630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f31bd9-7803-4aec-a79e-6e8ca5f00a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:35.032055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f31bd9-7803-4aec-a79e-6e8ca5f00a4b service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:35.049591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 651/1320] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:37.589295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c371-45a7-4bd2-80f2-5f8f854bc27f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:37.589846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c371-45a7-4bd2-80f2-5f8f854bc27f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:37.589846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c371-45a7-4bd2-80f2-5f8f854bc27f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:37.591213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 670/1321] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:37.596296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad90d-5d10-414e-ac40-15243875f4f7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:37.596715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad90d-5d10-414e-ac40-15243875f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:37.596881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad90d-5d10-414e-ac40-15243875f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:37.661772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d40ad90d-5d10-414e-ac40-15243875f4f7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:37.662956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d40ad90d-5d10-414e-ac40-15243875f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:37.720261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:37.761996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 652/1322] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:38.052472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216c371-45a7-4bd2-80f2-5f8f854bc27f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:38.054132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2216c371-45a7-4bd2-80f2-5f8f854bc27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:38.073791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:38.158238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216c371-45a7-4bd2-80f2-5f8f854bc27f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:38.230902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded8504-c237-49fc-8feb-16378b45e0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:38.231492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8504-c237-49fc-8feb-16378b45e0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:38.231762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8504-c237-49fc-8feb-16378b45e0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:38.232027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8504-c237-49fc-8feb-16378b45e0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:38.233647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2ded8504-c237-49fc-8feb-16378b45e0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:38.304730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:38.342414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded8504-c237-49fc-8feb-16378b45e0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:38.343837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded8504-c237-49fc-8feb-16378b45e0c3 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:38.361970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 671/1323] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:40.307261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea04c9-1456-4819-8fd9-4f06d62fcf27 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:40.307836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea04c9-1456-4819-8fd9-4f06d62fcf27 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:40.307836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea04c9-1456-4819-8fd9-4f06d62fcf27 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:40.309137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 653/1324] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:40.314309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee431-9834-4245-8809-aff8156b3200 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:40.314740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee431-9834-4245-8809-aff8156b3200 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:40.314987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee431-9834-4245-8809-aff8156b3200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:40.381548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c3bee431-9834-4245-8809-aff8156b3200 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:40.382647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c3bee431-9834-4245-8809-aff8156b3200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:40.480940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 672/1325] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:40.763969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea04c9-1456-4819-8fd9-4f06d62fcf27 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:40.765629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a3ea04c9-1456-4819-8fd9-4f06d62fcf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:40.869324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea04c9-1456-4819-8fd9-4f06d62fcf27 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:40.941835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544106a-6e13-46ea-b051-efaa527a134e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:40.942438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544106a-6e13-46ea-b051-efaa527a134e service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:40.942763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544106a-6e13-46ea-b051-efaa527a134e service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:40.942983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544106a-6e13-46ea-b051-efaa527a134e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:40.944625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5544106a-6e13-46ea-b051-efaa527a134e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:40.973782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:41.067279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544106a-6e13-46ea-b051-efaa527a134e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:41.068719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544106a-6e13-46ea-b051-efaa527a134e service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:41.086998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 654/1326] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:43.048672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa3a6-9409-4371-a42c-9c1049f5aaf5 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:43.049200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa3a6-9409-4371-a42c-9c1049f5aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:43.049200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa3a6-9409-4371-a42c-9c1049f5aaf5 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:43.050651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 673/1327] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:43.056048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e4ee1-c2fa-4b80-a30d-e8d2fcb8818e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:43.056486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e4ee1-c2fa-4b80-a30d-e8d2fcb8818e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:43.056628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e4ee1-c2fa-4b80-a30d-e8d2fcb8818e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:43.124547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a49e4ee1-c2fa-4b80-a30d-e8d2fcb8818e None None] MFA Rules not processed for user `a68b15b13af94675b3fa8fc734f85006`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:43.125733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a49e4ee1-c2fa-4b80-a30d-e8d2fcb8818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:43.193061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:43.230177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 655/1328] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:43.511452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aa3a6-9409-4371-a42c-9c1049f5aaf5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:43.512990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-666aa3a6-9409-4371-a42c-9c1049f5aaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:43.543253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:43.636948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aa3a6-9409-4371-a42c-9c1049f5aaf5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:43.718257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25053d-f9f1-427b-919c-88ba1a561f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:43.718856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25053d-f9f1-427b-919c-88ba1a561f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:43.719137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25053d-f9f1-427b-919c-88ba1a561f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:43.719409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25053d-f9f1-427b-919c-88ba1a561f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:43.721014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2d25053d-f9f1-427b-919c-88ba1a561f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:43.796777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:43.828935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25053d-f9f1-427b-919c-88ba1a561f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:43.830696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25053d-f9f1-427b-919c-88ba1a561f52 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:43.848503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 674/1329] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:45.941222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ef04-7570-4a1c-891d-fae908348f9f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:45.941798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ef04-7570-4a1c-891d-fae908348f9f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:45.941897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ef04-7570-4a1c-891d-fae908348f9f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:45.943237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 656/1330] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:45.948203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df6537-2ec6-4752-b845-2d1f2e1e5f40 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:45.948627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df6537-2ec6-4752-b845-2d1f2e1e5f40 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:45.948742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df6537-2ec6-4752-b845-2d1f2e1e5f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:46.018874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b9df6537-2ec6-4752-b845-2d1f2e1e5f40 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:46.020067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b9df6537-2ec6-4752-b845-2d1f2e1e5f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:46.114387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 675/1331] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:46.393050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ef04-7570-4a1c-891d-fae908348f9f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:46.395387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ec75ef04-7570-4a1c-891d-fae908348f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:46.498027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ef04-7570-4a1c-891d-fae908348f9f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:46.569896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea010e92-ca52-418a-8fd5-c977426273cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:46.570492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010e92-ca52-418a-8fd5-c977426273cd service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:46.570764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010e92-ca52-418a-8fd5-c977426273cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:46.571028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010e92-ca52-418a-8fd5-c977426273cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:46.572605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ea010e92-ca52-418a-8fd5-c977426273cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:46.599042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:46.687979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea010e92-ca52-418a-8fd5-c977426273cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:46.689452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea010e92-ca52-418a-8fd5-c977426273cd service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:46.708115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 657/1332] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:48.671797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858d82-2be7-4d41-93af-7dd5d3bf2cbe None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:48.672350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858d82-2be7-4d41-93af-7dd5d3bf2cbe None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:48.672596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90858d82-2be7-4d41-93af-7dd5d3bf2cbe None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:48.673982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 676/1333] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:48.679255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5ef4a-d97e-4d82-a5dd-52ce33d80458 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:48.679642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5ef4a-d97e-4d82-a5dd-52ce33d80458 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:48.679805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5ef4a-d97e-4d82-a5dd-52ce33d80458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:48.763954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-59e5ef4a-d97e-4d82-a5dd-52ce33d80458 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:48.765164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-59e5ef4a-d97e-4d82-a5dd-52ce33d80458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:48.839122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:48.861475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 658/1334] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:49.147561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90858d82-2be7-4d41-93af-7dd5d3bf2cbe None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:49.149103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-90858d82-2be7-4d41-93af-7dd5d3bf2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:49.188982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:49.252753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90858d82-2be7-4d41-93af-7dd5d3bf2cbe None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:49.323091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73acc3e-5a56-4f42-b658-df832b314873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:49.323676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acc3e-5a56-4f42-b658-df832b314873 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:49.323953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acc3e-5a56-4f42-b658-df832b314873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:49.324223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73acc3e-5a56-4f42-b658-df832b314873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:49.325818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a73acc3e-5a56-4f42-b658-df832b314873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:49.406156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:49.434195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73acc3e-5a56-4f42-b658-df832b314873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:49.435622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73acc3e-5a56-4f42-b658-df832b314873 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:49.453272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 677/1335] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:51.678388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab93c4-7c87-4079-ab99-60a9958e8283 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:51.678933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab93c4-7c87-4079-ab99-60a9958e8283 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:51.678933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab93c4-7c87-4079-ab99-60a9958e8283 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:51.680266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 659/1336] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:51.685390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace369fe-5921-4931-a37d-a377fe6b35e7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:51.685850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace369fe-5921-4931-a37d-a377fe6b35e7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:51.685976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace369fe-5921-4931-a37d-a377fe6b35e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:51.750170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ace369fe-5921-4931-a37d-a377fe6b35e7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:51.751346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ace369fe-5921-4931-a37d-a377fe6b35e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:51.847092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 678/1337] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:52.130265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab93c4-7c87-4079-ab99-60a9958e8283 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:52.131810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-95ab93c4-7c87-4079-ab99-60a9958e8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:52.233370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab93c4-7c87-4079-ab99-60a9958e8283 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:52.304372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6646136-20f4-4d49-a932-db68370a3d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:52.304966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646136-20f4-4d49-a932-db68370a3d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:52.305242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646136-20f4-4d49-a932-db68370a3d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:52.305541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6646136-20f4-4d49-a932-db68370a3d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:52.307106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e6646136-20f4-4d49-a932-db68370a3d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:52.343384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:52.415972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6646136-20f4-4d49-a932-db68370a3d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:52.417318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6646136-20f4-4d49-a932-db68370a3d7f service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:52.435267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 660/1338] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:56.369663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec19d9-7884-4ffa-96a5-6d4377c0a8ac None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:56.370210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec19d9-7884-4ffa-96a5-6d4377c0a8ac None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:56.370210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec19d9-7884-4ffa-96a5-6d4377c0a8ac None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:56.371723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 679/1339] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:56.376822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f0ba-4bec-466b-9e92-f945792de27b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:56.377249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f0ba-4bec-466b-9e92-f945792de27b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:56.377356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f0ba-4bec-466b-9e92-f945792de27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:56.447648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2fc2f0ba-4bec-466b-9e92-f945792de27b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:56.448850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2fc2f0ba-4bec-466b-9e92-f945792de27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:56.544288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:56.554028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 661/1340] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:08:56.855970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec19d9-7884-4ffa-96a5-6d4377c0a8ac None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:08:56.857556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e6ec19d9-7884-4ffa-96a5-6d4377c0a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:56.905997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:56.962935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec19d9-7884-4ffa-96a5-6d4377c0a8ac None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:08:57.037777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2b10-0bd6-4062-b3b3-3464fca8e82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:08:57.038374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2b10-0bd6-4062-b3b3-3464fca8e82d service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:57.038653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2b10-0bd6-4062-b3b3-3464fca8e82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:57.038919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2b10-0bd6-4062-b3b3-3464fca8e82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:57.040502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-38ad2b10-0bd6-4062-b3b3-3464fca8e82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:57.140928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:57.162253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad2b10-0bd6-4062-b3b3-3464fca8e82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:08:57.163675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad2b10-0bd6-4062-b3b3-3464fca8e82d service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:08:57.183794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 680/1341] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:08:59.734883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491700d3-c845-4838-aa53-f84dddfe2560 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:59.735407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491700d3-c845-4838-aa53-f84dddfe2560 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:59.735514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491700d3-c845-4838-aa53-f84dddfe2560 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:59.736825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 662/1342] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:08:59.742026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47da3-4609-495d-920a-cfe23cd983c8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:08:59.742488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47da3-4609-495d-920a-cfe23cd983c8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:08:59.742582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47da3-4609-495d-920a-cfe23cd983c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:08:59.810779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-77d47da3-4609-495d-920a-cfe23cd983c8 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:08:59.811963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-77d47da3-4609-495d-920a-cfe23cd983c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:08:59.909291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 681/1343] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:08:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:00.186350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491700d3-c845-4838-aa53-f84dddfe2560 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:00.187879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-491700d3-c845-4838-aa53-f84dddfe2560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:00.291972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491700d3-c845-4838-aa53-f84dddfe2560 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:00.369402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736b50d-da9e-44f9-a2c7-c858e3965c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:00.370041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b50d-da9e-44f9-a2c7-c858e3965c8e service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:00.370318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b50d-da9e-44f9-a2c7-c858e3965c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:00.370587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b50d-da9e-44f9-a2c7-c858e3965c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:00.372193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a736b50d-da9e-44f9-a2c7-c858e3965c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:00.415604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:00.483050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736b50d-da9e-44f9-a2c7-c858e3965c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:00.484704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736b50d-da9e-44f9-a2c7-c858e3965c8e service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:00.503137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 663/1344] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:04.382346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a19f-b940-484f-8f4a-55e7138457c9 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:04.382844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a19f-b940-484f-8f4a-55e7138457c9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:04.382938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a19f-b940-484f-8f4a-55e7138457c9 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:04.384236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 682/1345] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:04.389439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58ecb5-7feb-4580-b764-0cc0c49d09d7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:04.389902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58ecb5-7feb-4580-b764-0cc0c49d09d7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:04.390080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58ecb5-7feb-4580-b764-0cc0c49d09d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:04.465064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-df58ecb5-7feb-4580-b764-0cc0c49d09d7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:04.466307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-df58ecb5-7feb-4580-b764-0cc0c49d09d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:04.568499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:04.571247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 664/1346] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:04.857204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104a19f-b940-484f-8f4a-55e7138457c9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:04.858772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8104a19f-b940-484f-8f4a-55e7138457c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:04.943715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:04.995916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104a19f-b940-484f-8f4a-55e7138457c9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:05.077547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838e6ff-a806-46d2-83c0-d7a7b7d6d14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:05.078431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838e6ff-a806-46d2-83c0-d7a7b7d6d14d service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:05.078711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838e6ff-a806-46d2-83c0-d7a7b7d6d14d service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:05.078980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838e6ff-a806-46d2-83c0-d7a7b7d6d14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:05.080862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5838e6ff-a806-46d2-83c0-d7a7b7d6d14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:05.191847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:05.195832 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838e6ff-a806-46d2-83c0-d7a7b7d6d14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:05.198063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838e6ff-a806-46d2-83c0-d7a7b7d6d14d service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:05.216510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 683/1347] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:10.182056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7de56-6cad-4775-be35-eb5c90e67803 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:10.182598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7de56-6cad-4775-be35-eb5c90e67803 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:10.182598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7de56-6cad-4775-be35-eb5c90e67803 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:10.183963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 665/1348] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:10.188924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbf9a4-0664-4214-ae9f-3ecc0b455997 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:10.189364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbf9a4-0664-4214-ae9f-3ecc0b455997 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:10.189454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbf9a4-0664-4214-ae9f-3ecc0b455997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:10.351009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-edbbf9a4-0664-4214-ae9f-3ecc0b455997 None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:10.352529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-edbbf9a4-0664-4214-ae9f-3ecc0b455997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:10.465433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 684/1349] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:09:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:09:14.654772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864cc9-fdd5-450a-a073-c1fdf587d64a None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:14.655340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864cc9-fdd5-450a-a073-c1fdf587d64a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:14.655340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864cc9-fdd5-450a-a073-c1fdf587d64a None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:14.656634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 666/1350] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:14.662072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a612-567c-4139-9434-ee62a4a34a26 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:14.662475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a612-567c-4139-9434-ee62a4a34a26 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:14.662719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683a612-567c-4139-9434-ee62a4a34a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:14.717708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:14.742713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8683a612-567c-4139-9434-ee62a4a34a26 None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:14.743908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8683a612-567c-4139-9434-ee62a4a34a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:14.855809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 685/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:09:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:16.167132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1079-f235-43f1-bfbb-de81df3778a7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:16.167674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1079-f235-43f1-bfbb-de81df3778a7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:16.167674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1079-f235-43f1-bfbb-de81df3778a7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:16.169107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 667/1352] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:16.174386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828753-c1a2-4965-a3e1-1459eb125968 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:16.174828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828753-c1a2-4965-a3e1-1459eb125968 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:16.174979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828753-c1a2-4965-a3e1-1459eb125968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:16.252100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-64828753-c1a2-4965-a3e1-1459eb125968 None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:16.253830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-64828753-c1a2-4965-a3e1-1459eb125968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:16.296774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:16.362863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 686/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:09:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:09:19.598266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a023-2044-4dff-8280-4d4ebd36d6fc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:19.598733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a023-2044-4dff-8280-4d4ebd36d6fc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:19.598829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a023-2044-4dff-8280-4d4ebd36d6fc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:19.600151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 668/1354] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:19.605258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c839e-5b69-44ff-8244-532d985f1928 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:19.605721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c839e-5b69-44ff-8244-532d985f1928 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:19.605869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c839e-5b69-44ff-8244-532d985f1928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:19.696071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7a1c839e-5b69-44ff-8244-532d985f1928 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:19.697635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7a1c839e-5b69-44ff-8244-532d985f1928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:19.819691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 687/1355] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:09:20.125687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a2f3-9f48-4bb6-b25c-758a1e6e47a7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:20.126252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a2f3-9f48-4bb6-b25c-758a1e6e47a7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:20.126738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0a2f3-9f48-4bb6-b25c-758a1e6e47a7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:20.130467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 669/1356] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 30 04:09:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:20.137396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28cf5-e762-4a55-b0ed-073c5b7a34a2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:20.138566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28cf5-e762-4a55-b0ed-073c5b7a34a2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:20.139138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28cf5-e762-4a55-b0ed-073c5b7a34a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:20.159766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:20.225563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3dc28cf5-e762-4a55-b0ed-073c5b7a34a2 None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:20.227043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3dc28cf5-e762-4a55-b0ed-073c5b7a34a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:20.367654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 688/1357] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 30 04:09:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:09:20.368784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a2f3-9f48-4bb6-b25c-758a1e6e47a7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:20.370512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-09d0a2f3-9f48-4bb6-b25c-758a1e6e47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:20.540542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0a2f3-9f48-4bb6-b25c-758a1e6e47a7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:20.629623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:20.672543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b48e71-bc13-4230-86d1-0c0b2836a5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:20.673254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b48e71-bc13-4230-86d1-0c0b2836a5a8 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:20.673551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b48e71-bc13-4230-86d1-0c0b2836a5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:20.673821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b48e71-bc13-4230-86d1-0c0b2836a5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:20.675985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-17b48e71-bc13-4230-86d1-0c0b2836a5a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:20.771562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b48e71-bc13-4230-86d1-0c0b2836a5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:20.773251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b48e71-bc13-4230-86d1-0c0b2836a5a8 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:20.794721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 670/1358] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:22.910981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f51e7b-69af-4f29-985a-ddaa3a9e0bbf None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:22.911538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f51e7b-69af-4f29-985a-ddaa3a9e0bbf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:22.911538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f51e7b-69af-4f29-985a-ddaa3a9e0bbf None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:22.913048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 689/1359] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:22.918621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a156-a4ba-452c-b08f-95c2b15ccae6 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:22.919160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a156-a4ba-452c-b08f-95c2b15ccae6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:22.919160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a156-a4ba-452c-b08f-95c2b15ccae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:22.992473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-49c1a156-a4ba-452c-b08f-95c2b15ccae6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:22.993684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-49c1a156-a4ba-452c-b08f-95c2b15ccae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:23.032332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:23.095442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 671/1360] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:23.396628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f51e7b-69af-4f29-985a-ddaa3a9e0bbf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:23.398231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f7f51e7b-69af-4f29-985a-ddaa3a9e0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:23.465339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:23.554902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f51e7b-69af-4f29-985a-ddaa3a9e0bbf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:23.688186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6c91c-f8d5-4f25-a409-e8bc84a8d7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:23.689037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c91c-f8d5-4f25-a409-e8bc84a8d7ec service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:23.689467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c91c-f8d5-4f25-a409-e8bc84a8d7ec service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:23.689940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c91c-f8d5-4f25-a409-e8bc84a8d7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:23.692065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-13e6c91c-f8d5-4f25-a409-e8bc84a8d7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:23.716355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:23.800972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6c91c-f8d5-4f25-a409-e8bc84a8d7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:23.802588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6c91c-f8d5-4f25-a409-e8bc84a8d7ec service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:23.821335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 690/1361] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:26.114009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936df8-7b04-4b4c-9ba0-214e7e4dcefc None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:26.114579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936df8-7b04-4b4c-9ba0-214e7e4dcefc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:26.114579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936df8-7b04-4b4c-9ba0-214e7e4dcefc None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:26.117751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 672/1362] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:26.121556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc777-d6a0-4246-9840-5d3994bddec1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:26.122009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc777-d6a0-4246-9840-5d3994bddec1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:26.122097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cc777-d6a0-4246-9840-5d3994bddec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:26.204428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bc8cc777-d6a0-4246-9840-5d3994bddec1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:26.206504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bc8cc777-d6a0-4246-9840-5d3994bddec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:26.305061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:26.317555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 691/1363] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:26.603239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6733b8-93dc-4c27-8fcd-23b6062a6e1d None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:26.603515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6733b8-93dc-4c27-8fcd-23b6062a6e1d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:26.603807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6733b8-93dc-4c27-8fcd-23b6062a6e1d None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:26.605148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 673/1364] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 30 04:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:26.610622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94c28-da47-4eb4-bbff-e74263eae07d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:26.610894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94c28-da47-4eb4-bbff-e74263eae07d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:26.611158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df94c28-da47-4eb4-bbff-e74263eae07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:26.691803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3df94c28-da47-4eb4-bbff-e74263eae07d None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:26.693022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3df94c28-da47-4eb4-bbff-e74263eae07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:26.814063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 692/1365] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 30 04:09:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:26.822236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6733b8-93dc-4c27-8fcd-23b6062a6e1d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:26.823526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fc6733b8-93dc-4c27-8fcd-23b6062a6e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:26.987310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6733b8-93dc-4c27-8fcd-23b6062a6e1d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:27.011022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:27.112567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d62ab3-fd42-43ad-91a1-bd194f479006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:27.113248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62ab3-fd42-43ad-91a1-bd194f479006 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:27.113605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62ab3-fd42-43ad-91a1-bd194f479006 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:27.113876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62ab3-fd42-43ad-91a1-bd194f479006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:27.115467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d0d62ab3-fd42-43ad-91a1-bd194f479006 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:27.207863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d62ab3-fd42-43ad-91a1-bd194f479006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:27.209984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d62ab3-fd42-43ad-91a1-bd194f479006 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:27.230967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 674/1366] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:27.846257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad444d-a412-4589-8fae-8cb3c16217ad None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:27.846782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad444d-a412-4589-8fae-8cb3c16217ad None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:27.847165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad444d-a412-4589-8fae-8cb3c16217ad None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:27.849252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 693/1367] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:27.854546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9d6c-c817-4a23-8ca9-46bd945b997f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:27.854845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9d6c-c817-4a23-8ca9-46bd945b997f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:27.855102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9d6c-c817-4a23-8ca9-46bd945b997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:27.891808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:27.930537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-72cb9d6c-c817-4a23-8ca9-46bd945b997f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:27.931945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-72cb9d6c-c817-4a23-8ca9-46bd945b997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:28.035889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 675/1368] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:28.654760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4869-d9bc-4e62-a85e-680c7b4bace3 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:28.655049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4869-d9bc-4e62-a85e-680c7b4bace3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:28.655319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4869-d9bc-4e62-a85e-680c7b4bace3 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:28.656792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 694/1369] 10.222.0.69 () {54 vars in 964 bytes} [Tue Aug 30 04:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:28.661888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c18e3-71c9-4dd7-979f-2dd7d3990e29 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:28.662417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c18e3-71c9-4dd7-979f-2dd7d3990e29 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:28.662417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c18e3-71c9-4dd7-979f-2dd7d3990e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:28.742686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-140c18e3-71c9-4dd7-979f-2dd7d3990e29 None None] MFA Rules not processed for user `94e017d6c128460eb8506dfb32697f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:28.743905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-140c18e3-71c9-4dd7-979f-2dd7d3990e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:28.791075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:28.822944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 676/1370] 10.222.0.69 () {58 vars in 1061 bytes} [Tue Aug 30 04:09:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:28.830956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec4869-d9bc-4e62-a85e-680c7b4bace3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:28.832480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-83ec4869-d9bc-4e62-a85e-680c7b4bace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:28.883753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:28.939316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec4869-d9bc-4e62-a85e-680c7b4bace3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:29.019826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd28c-2dc3-4238-b43b-82990aca3033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:29.020335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd28c-2dc3-4238-b43b-82990aca3033 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:29.020607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd28c-2dc3-4238-b43b-82990aca3033 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:29.020868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd28c-2dc3-4238-b43b-82990aca3033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:29.022550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f73bd28c-2dc3-4238-b43b-82990aca3033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:29.125100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:29.140440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd28c-2dc3-4238-b43b-82990aca3033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:29.141954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd28c-2dc3-4238-b43b-82990aca3033 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:29.160699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 695/1371] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:29.245740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4584-87f6-4733-898d-2ee5647b07b5 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:29.246137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4584-87f6-4733-898d-2ee5647b07b5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:29.246397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4584-87f6-4733-898d-2ee5647b07b5 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:29.247929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 677/1372] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:29.252668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2293-e83c-4e7e-86ba-331def23ed0c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:29.253041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2293-e83c-4e7e-86ba-331def23ed0c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:29.253330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2293-e83c-4e7e-86ba-331def23ed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:29.331387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-aebf2293-e83c-4e7e-86ba-331def23ed0c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:29.333257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aebf2293-e83c-4e7e-86ba-331def23ed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:29.454122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 696/1373] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:29.740228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4584-87f6-4733-898d-2ee5647b07b5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:29.741816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-353e4584-87f6-4733-898d-2ee5647b07b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:29.890743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4584-87f6-4733-898d-2ee5647b07b5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:29.941762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:30.006791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d07b3e-667d-475d-882e-b52b6d07a524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:30.007306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07b3e-667d-475d-882e-b52b6d07a524 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:30.007581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07b3e-667d-475d-882e-b52b6d07a524 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:30.007843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07b3e-667d-475d-882e-b52b6d07a524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:30.009402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-21d07b3e-667d-475d-882e-b52b6d07a524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:30.097204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d07b3e-667d-475d-882e-b52b6d07a524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:30.098814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d07b3e-667d-475d-882e-b52b6d07a524 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:30.116906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 678/1374] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:32.047046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596471-8ff9-4fb8-9755-7a5689291125 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:32.047582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596471-8ff9-4fb8-9755-7a5689291125 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:32.047582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596471-8ff9-4fb8-9755-7a5689291125 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:32.048949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 697/1375] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:32.054035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5a37-4df7-4e9f-aa5c-36b2290610fa None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:32.054467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5a37-4df7-4e9f-aa5c-36b2290610fa None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:32.054567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5a37-4df7-4e9f-aa5c-36b2290610fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:32.125410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c52b5a37-4df7-4e9f-aa5c-36b2290610fa None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:32.126633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c52b5a37-4df7-4e9f-aa5c-36b2290610fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:32.134974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:32.239543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 679/1376] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:32.533060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df596471-8ff9-4fb8-9755-7a5689291125 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:32.534849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-df596471-8ff9-4fb8-9755-7a5689291125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:32.612586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:32.715143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df596471-8ff9-4fb8-9755-7a5689291125 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:32.842659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425787e-b769-448d-891e-01c5cc67d448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:32.843456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425787e-b769-448d-891e-01c5cc67d448 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:32.843852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425787e-b769-448d-891e-01c5cc67d448 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:32.844210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425787e-b769-448d-891e-01c5cc67d448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:32.846495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f425787e-b769-448d-891e-01c5cc67d448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:32.867710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:32.944799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425787e-b769-448d-891e-01c5cc67d448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:32.946461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425787e-b769-448d-891e-01c5cc67d448 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:32.965966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 698/1377] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:09:34.923362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d0e23-95c7-47f3-b400-df739c32b665 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:34.924461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d0e23-95c7-47f3-b400-df739c32b665 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:34.924563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d0e23-95c7-47f3-b400-df739c32b665 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:34.926074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 680/1378] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:34.931092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536aabf-03b5-4171-affb-0a64da9b3278 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:34.931494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536aabf-03b5-4171-affb-0a64da9b3278 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:34.931654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536aabf-03b5-4171-affb-0a64da9b3278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:35.008375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b536aabf-03b5-4171-affb-0a64da9b3278 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:35.009603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b536aabf-03b5-4171-affb-0a64da9b3278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:35.110522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:35.121996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 699/1379] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:09:35.405898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d0e23-95c7-47f3-b400-df739c32b665 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:35.407568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-683d0e23-95c7-47f3-b400-df739c32b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:35.559611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:35.571670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d0e23-95c7-47f3-b400-df739c32b665 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:35.691129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef3985-6931-46b4-b0dc-5c5a9be91891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:35.692009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3985-6931-46b4-b0dc-5c5a9be91891 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:35.692499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3985-6931-46b4-b0dc-5c5a9be91891 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:35.693545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3985-6931-46b4-b0dc-5c5a9be91891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:35.694895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e6ef3985-6931-46b4-b0dc-5c5a9be91891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:35.790385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef3985-6931-46b4-b0dc-5c5a9be91891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:35.792099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef3985-6931-46b4-b0dc-5c5a9be91891 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:35.803252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:35.812982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 681/1380] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:37.809838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb31865-3621-4aeb-a2c9-bccc81c87ede None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:37.810414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb31865-3621-4aeb-a2c9-bccc81c87ede None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:37.810414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb31865-3621-4aeb-a2c9-bccc81c87ede None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:37.811742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 700/1381] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:37.818423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87cb2-59d7-4cd2-b9b8-6a0fcd7e136b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:37.818864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87cb2-59d7-4cd2-b9b8-6a0fcd7e136b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:37.819322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87cb2-59d7-4cd2-b9b8-6a0fcd7e136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:37.897433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ebb87cb2-59d7-4cd2-b9b8-6a0fcd7e136b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:37.898609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ebb87cb2-59d7-4cd2-b9b8-6a0fcd7e136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:38.007313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 682/1382] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:38.292411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb31865-3621-4aeb-a2c9-bccc81c87ede None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:38.294053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ceb31865-3621-4aeb-a2c9-bccc81c87ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:38.450995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb31865-3621-4aeb-a2c9-bccc81c87ede None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:38.521188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:38.567312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74bb05-eb48-4ad5-842c-5fc460212b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:38.567817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74bb05-eb48-4ad5-842c-5fc460212b3f service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:38.568086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74bb05-eb48-4ad5-842c-5fc460212b3f service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:38.568350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74bb05-eb48-4ad5-842c-5fc460212b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:38.569988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1e74bb05-eb48-4ad5-842c-5fc460212b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:38.660582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74bb05-eb48-4ad5-842c-5fc460212b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:38.662209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74bb05-eb48-4ad5-842c-5fc460212b3f service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:38.682745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 701/1383] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:40.641888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4e62f-7998-4515-86da-78d0211e0abf None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:40.642476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4e62f-7998-4515-86da-78d0211e0abf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:40.642620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4e62f-7998-4515-86da-78d0211e0abf None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:40.644347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 683/1384] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:40.650090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1f20-2a43-4f1f-9abc-22cd8ea6c509 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:40.650527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1f20-2a43-4f1f-9abc-22cd8ea6c509 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:40.650706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1f20-2a43-4f1f-9abc-22cd8ea6c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:40.727220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-00cb1f20-2a43-4f1f-9abc-22cd8ea6c509 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:40.728555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-00cb1f20-2a43-4f1f-9abc-22cd8ea6c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:40.762465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:40.831299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 702/1385] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:41.152384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4e62f-7998-4515-86da-78d0211e0abf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:41.154267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1bf4e62f-7998-4515-86da-78d0211e0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:41.245287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:41.323725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4e62f-7998-4515-86da-78d0211e0abf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:41.438046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345b46b-068a-46fe-975e-a7e8890b29df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:41.438576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345b46b-068a-46fe-975e-a7e8890b29df service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:41.438851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345b46b-068a-46fe-975e-a7e8890b29df service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:41.439116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345b46b-068a-46fe-975e-a7e8890b29df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:41.440744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3345b46b-068a-46fe-975e-a7e8890b29df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:41.481166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:41.536397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345b46b-068a-46fe-975e-a7e8890b29df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:41.538007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345b46b-068a-46fe-975e-a7e8890b29df service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:41.559652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 684/1386] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:43.536666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7793a6-ef74-4972-a9de-1aeae03114bc None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:43.537250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7793a6-ef74-4972-a9de-1aeae03114bc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:43.537250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7793a6-ef74-4972-a9de-1aeae03114bc None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:43.538570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 703/1387] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:43.543647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c633-8dcf-4368-a80b-6330e1f12a64 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:43.544052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c633-8dcf-4368-a80b-6330e1f12a64 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:43.544188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c633-8dcf-4368-a80b-6330e1f12a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:43.610298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-64a7c633-8dcf-4368-a80b-6330e1f12a64 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:43.611531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-64a7c633-8dcf-4368-a80b-6330e1f12a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:43.708473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 685/1388] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:44.003445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7793a6-ef74-4972-a9de-1aeae03114bc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:44.004967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fb7793a6-ef74-4972-a9de-1aeae03114bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:44.163224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7793a6-ef74-4972-a9de-1aeae03114bc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:44.180341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:44.248223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d00b5-82e1-4d59-adeb-6ba549046626 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:44.248530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d00b5-82e1-4d59-adeb-6ba549046626 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:44.248858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d00b5-82e1-4d59-adeb-6ba549046626 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:44.250311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 686/1389] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:09:44.255146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025a3e-4686-4986-bb90-f5fcc273cbee None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:44.255421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025a3e-4686-4986-bb90-f5fcc273cbee None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:44.255691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025a3e-4686-4986-bb90-f5fcc273cbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:44.271385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:44.279508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63a58-3ce7-47ee-b3cc-4874541d6fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:44.280107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63a58-3ce7-47ee-b3cc-4874541d6fad service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:44.280378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63a58-3ce7-47ee-b3cc-4874541d6fad service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:44.280641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63a58-3ce7-47ee-b3cc-4874541d6fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:44.282353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-17f63a58-3ce7-47ee-b3cc-4874541d6fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:44.323187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-05025a3e-4686-4986-bb90-f5fcc273cbee None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:44.324385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-05025a3e-4686-4986-bb90-f5fcc273cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:44.370809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63a58-3ce7-47ee-b3cc-4874541d6fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:44.372434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63a58-3ce7-47ee-b3cc-4874541d6fad service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:44.389906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 704/1390] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:44.424728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 687/1391] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:09:44.725313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a92c6-b1ca-406f-9886-bafbf0897e83 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:44.725870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a92c6-b1ca-406f-9886-bafbf0897e83 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:44.725978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a92c6-b1ca-406f-9886-bafbf0897e83 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:44.727335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 705/1392] 10.222.0.69 () {54 vars in 967 bytes} [Tue Aug 30 04:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:44.732373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9baf4-515f-4d82-95fc-270a7b255076 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:44.732792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9baf4-515f-4d82-95fc-270a7b255076 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:44.732917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9baf4-515f-4d82-95fc-270a7b255076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:44.809796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b6f9baf4-515f-4d82-95fc-270a7b255076 None None] MFA Rules not processed for user `aa77ec9b56cd4027b22fbe0d7ff3ee1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:44.811035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b6f9baf4-515f-4d82-95fc-270a7b255076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:44.847857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:44.889918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 688/1393] 10.222.0.69 () {58 vars in 1064 bytes} [Tue Aug 30 04:09:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:44.898273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a92c6-b1ca-406f-9886-bafbf0897e83 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:44.899888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-440a92c6-b1ca-406f-9886-bafbf0897e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:44.922943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:45.006723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a92c6-b1ca-406f-9886-bafbf0897e83 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:45.079446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd73e2-8ae2-4bcf-a6ea-3f3d3d97182a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa77ec9b56cd4027b22fbe0d7ff3ee1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:45.080305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd73e2-8ae2-4bcf-a6ea-3f3d3d97182a service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:45.080578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd73e2-8ae2-4bcf-a6ea-3f3d3d97182a service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:45.080847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd73e2-8ae2-4bcf-a6ea-3f3d3d97182a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:45.082450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-27bd73e2-8ae2-4bcf-a6ea-3f3d3d97182a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:45.155779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:45.192616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd73e2-8ae2-4bcf-a6ea-3f3d3d97182a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:45.194078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd73e2-8ae2-4bcf-a6ea-3f3d3d97182a service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:45.211875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 706/1394] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:45.938555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6bbf-7c3c-4cb8-a21a-538e8b07fae2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:45.939047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6bbf-7c3c-4cb8-a21a-538e8b07fae2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:45.939147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6bbf-7c3c-4cb8-a21a-538e8b07fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:46.006982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e5fa6bbf-7c3c-4cb8-a21a-538e8b07fae2 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:46.008184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e5fa6bbf-7c3c-4cb8-a21a-538e8b07fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:46.103183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 689/1395] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:09:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:46.150668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a152c1-c748-4235-b2f6-38200e301106 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:46.151123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a152c1-c748-4235-b2f6-38200e301106 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:46.151237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a152c1-c748-4235-b2f6-38200e301106 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:46.152563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 707/1396] 10.222.0.69 () {54 vars in 943 bytes} [Tue Aug 30 04:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:46.158771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375087c4-9e95-4620-ae3e-f815d21ff538 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:46.159128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375087c4-9e95-4620-ae3e-f815d21ff538 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:46.159481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375087c4-9e95-4620-ae3e-f815d21ff538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:46.217615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:46.236187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-375087c4-9e95-4620-ae3e-f815d21ff538 None None] MFA Rules not processed for user `16ba94b3c081488a851579dc5883427b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:46.237379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-375087c4-9e95-4620-ae3e-f815d21ff538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:46.343280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 690/1397] 10.222.0.69 () {58 vars in 1040 bytes} [Tue Aug 30 04:09:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:46.347092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f4be-fa1e-4304-8fe3-1c386a8c1aaa None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:46.347404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f4be-fa1e-4304-8fe3-1c386a8c1aaa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:46.347679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61f4be-fa1e-4304-8fe3-1c386a8c1aaa None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:46.349017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 708/1398] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:46.352666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375087c4-9e95-4620-ae3e-f815d21ff538 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:46.354322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:46.354607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:46.354883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:46.362654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375087c4-9e95-4620-ae3e-f815d21ff538 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:46.421265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:46.422496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:46.462465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:46.468220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158288c-3d35-4550-bb5f-4301c15a3af6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:46.468829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158288c-3d35-4550-bb5f-4301c15a3af6 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:46.469110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158288c-3d35-4550-bb5f-4301c15a3af6 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:46.469375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158288c-3d35-4550-bb5f-4301c15a3af6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:46.471072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5158288c-3d35-4550-bb5f-4301c15a3af6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:46.520909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 709/1399] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:09:46.555816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158288c-3d35-4550-bb5f-4301c15a3af6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:46.557411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158288c-3d35-4550-bb5f-4301c15a3af6 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:46.565910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 691/1400] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:09:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:46.815903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:46.817107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:46.850408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:46.944475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf21b65-de58-4f0f-84ef-f4e48f51b3cf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:47.073650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd0285-9102-4ccc-add6-af9eb8274449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:47.074191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0285-9102-4ccc-add6-af9eb8274449 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:47.074463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0285-9102-4ccc-add6-af9eb8274449 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:47.074724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0285-9102-4ccc-add6-af9eb8274449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:47.076294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-02bd0285-9102-4ccc-add6-af9eb8274449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:47.106415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:47.178263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd0285-9102-4ccc-add6-af9eb8274449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:47.179863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd0285-9102-4ccc-add6-af9eb8274449 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:47.201782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 710/1401] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:49.180997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319a1dd-0114-48e4-8679-0002f0cc04b1 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:49.181473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319a1dd-0114-48e4-8679-0002f0cc04b1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:49.181619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319a1dd-0114-48e4-8679-0002f0cc04b1 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:49.182895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 692/1402] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:49.188053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957115-198d-4cbe-aa77-b9fc590fee98 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:49.188476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957115-198d-4cbe-aa77-b9fc590fee98 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:49.188604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38957115-198d-4cbe-aa77-b9fc590fee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:49.258910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-38957115-198d-4cbe-aa77-b9fc590fee98 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:49.260131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-38957115-198d-4cbe-aa77-b9fc590fee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:49.365824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 711/1403] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:49.655807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319a1dd-0114-48e4-8679-0002f0cc04b1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:49.657320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5319a1dd-0114-48e4-8679-0002f0cc04b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:49.802469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:49.814120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319a1dd-0114-48e4-8679-0002f0cc04b1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:49.933574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80353cc-896c-412a-953b-521f0ed3d250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:49.934087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80353cc-896c-412a-953b-521f0ed3d250 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:49.934367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80353cc-896c-412a-953b-521f0ed3d250 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:49.934602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80353cc-896c-412a-953b-521f0ed3d250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:49.936180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a80353cc-896c-412a-953b-521f0ed3d250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:50.037838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80353cc-896c-412a-953b-521f0ed3d250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:50.039420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80353cc-896c-412a-953b-521f0ed3d250 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:50.049552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:50.058837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 693/1404] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:52.010954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15040-8065-42f7-8c95-b70dc8743730 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:52.011591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15040-8065-42f7-8c95-b70dc8743730 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:52.011591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15040-8065-42f7-8c95-b70dc8743730 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:52.013088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 712/1405] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:09:52.018728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1148c2-2c6d-4130-84c1-66da723a3f32 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:52.019226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1148c2-2c6d-4130-84c1-66da723a3f32 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:52.019331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1148c2-2c6d-4130-84c1-66da723a3f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:52.089499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ea1148c2-2c6d-4130-84c1-66da723a3f32 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:09:52.090744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ea1148c2-2c6d-4130-84c1-66da723a3f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:52.211571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 694/1406] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:09:52.503006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15040-8065-42f7-8c95-b70dc8743730 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:09:52.504519 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f7a15040-8065-42f7-8c95-b70dc8743730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:52.507649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:52.675451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15040-8065-42f7-8c95-b70dc8743730 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:09:52.762313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:52.807863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8dbf7-0ff8-4ce8-8bcd-b466b4c69777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:09:52.808473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8dbf7-0ff8-4ce8-8bcd-b466b4c69777 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:09:52.808756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8dbf7-0ff8-4ce8-8bcd-b466b4c69777 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:09:52.809028 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8dbf7-0ff8-4ce8-8bcd-b466b4c69777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:09:52.810662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1cc8dbf7-0ff8-4ce8-8bcd-b466b4c69777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:09:52.919816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8dbf7-0ff8-4ce8-8bcd-b466b4c69777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:09:52.921413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8dbf7-0ff8-4ce8-8bcd-b466b4c69777 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:09:52.941341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 713/1407] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:02.209367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=67 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:02.937903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=61 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:08.886544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76128-f6bd-49e4-8ae4-1aeb4b5ed414 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:08.887078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76128-f6bd-49e4-8ae4-1aeb4b5ed414 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:08.887078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76128-f6bd-49e4-8ae4-1aeb4b5ed414 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:08.888349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 695/1408] 10.222.0.69 () {54 vars in 918 bytes} [Tue Aug 30 04:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:08.893566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a57a9-6c17-4bd8-87ac-70c0a6568be7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:08.894032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a57a9-6c17-4bd8-87ac-70c0a6568be7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:08.894148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a57a9-6c17-4bd8-87ac-70c0a6568be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:08.969197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ed8a57a9-6c17-4bd8-87ac-70c0a6568be7 None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:08.970903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ed8a57a9-6c17-4bd8-87ac-70c0a6568be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:09.075523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 714/1409] 10.222.0.69 () {58 vars in 1015 bytes} [Tue Aug 30 04:10:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:09.090574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b78de-1eae-4f4b-b7cf-cef771130982 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:09.090859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b78de-1eae-4f4b-b7cf-cef771130982 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:09.091131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b78de-1eae-4f4b-b7cf-cef771130982 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:09.092460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 696/1410] 10.222.0.69 () {54 vars in 918 bytes} [Tue Aug 30 04:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:09.097449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b3eb-9f51-4099-95ee-428d55b31964 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:09.097770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b3eb-9f51-4099-95ee-428d55b31964 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:09.098037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b3eb-9f51-4099-95ee-428d55b31964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:09.168795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:09.171399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6853b3eb-9f51-4099-95ee-428d55b31964 None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:09.173594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6853b3eb-9f51-4099-95ee-428d55b31964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:09.286279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 715/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Tue Aug 30 04:10:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:10:11.676459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d010-ff6f-4030-8ce1-27e570034875 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:11.676969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d010-ff6f-4030-8ce1-27e570034875 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:11.676969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920d010-ff6f-4030-8ce1-27e570034875 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:11.678387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 697/1412] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:11.683548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc3f4-7ddc-48d7-b556-eeb7153aedd2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:11.683963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc3f4-7ddc-48d7-b556-eeb7153aedd2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:11.684087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc3f4-7ddc-48d7-b556-eeb7153aedd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:11.752501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e03cc3f4-7ddc-48d7-b556-eeb7153aedd2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:11.753804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e03cc3f4-7ddc-48d7-b556-eeb7153aedd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:11.808019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:11.850794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 716/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:12.141164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d010-ff6f-4030-8ce1-27e570034875 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:12.142774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6920d010-ff6f-4030-8ce1-27e570034875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:12.286722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920d010-ff6f-4030-8ce1-27e570034875 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:12.358794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:12.398710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdda979-62f2-45af-a7f7-01dad6a733e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:12.399548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda979-62f2-45af-a7f7-01dad6a733e4 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:12.400051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda979-62f2-45af-a7f7-01dad6a733e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:12.400538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda979-62f2-45af-a7f7-01dad6a733e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:12.402475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5cdda979-62f2-45af-a7f7-01dad6a733e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:12.499127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdda979-62f2-45af-a7f7-01dad6a733e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:12.500704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdda979-62f2-45af-a7f7-01dad6a733e4 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:12.518241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 698/1414] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:13.414409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141bda4-a51e-4bd8-9ba4-fc7ef12b2745 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:13.414945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141bda4-a51e-4bd8-9ba4-fc7ef12b2745 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:13.414945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141bda4-a51e-4bd8-9ba4-fc7ef12b2745 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:13.416271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 717/1415] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:13.421272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad116c-a9fc-431e-86de-496d312a2b54 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:13.421684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad116c-a9fc-431e-86de-496d312a2b54 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:13.421844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad116c-a9fc-431e-86de-496d312a2b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:13.510555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-35ad116c-a9fc-431e-86de-496d312a2b54 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:13.511746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-35ad116c-a9fc-431e-86de-496d312a2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:13.537869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:13.608108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 699/1416] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:13.758627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141bda4-a51e-4bd8-9ba4-fc7ef12b2745 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:13.760080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d141bda4-a51e-4bd8-9ba4-fc7ef12b2745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:13.900121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141bda4-a51e-4bd8-9ba4-fc7ef12b2745 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:13.938072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:14.010810 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849b7fc-7b5d-48d7-b069-ed2b1b534d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:14.011329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b7fc-7b5d-48d7-b069-ed2b1b534d10 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:14.011610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b7fc-7b5d-48d7-b069-ed2b1b534d10 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:14.011885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b7fc-7b5d-48d7-b069-ed2b1b534d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:14.013463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b849b7fc-7b5d-48d7-b069-ed2b1b534d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:14.100896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849b7fc-7b5d-48d7-b069-ed2b1b534d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:14.102515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849b7fc-7b5d-48d7-b069-ed2b1b534d10 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:14.120133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 718/1417] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:15.025834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9899c76-dde7-4268-8745-096db0ca0a1c None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:15.026464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9899c76-dde7-4268-8745-096db0ca0a1c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:15.026464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9899c76-dde7-4268-8745-096db0ca0a1c None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:15.027729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 700/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:15.034253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e683-21ff-4f8b-a70b-4bd4d2d591d9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:15.034253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e683-21ff-4f8b-a70b-4bd4d2d591d9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:15.034954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e683-21ff-4f8b-a70b-4bd4d2d591d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:15.086728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:15.108768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-66c3e683-21ff-4f8b-a70b-4bd4d2d591d9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:15.110091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-66c3e683-21ff-4f8b-a70b-4bd4d2d591d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:15.234227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 719/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:15.386685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9899c76-dde7-4268-8745-096db0ca0a1c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:15.388202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e9899c76-dde7-4268-8745-096db0ca0a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:15.533382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9899c76-dde7-4268-8745-096db0ca0a1c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:15.545425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:15.648639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de12ee0-7470-4b55-a8d5-4e13e755098f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:15.649236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12ee0-7470-4b55-a8d5-4e13e755098f service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:15.649522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12ee0-7470-4b55-a8d5-4e13e755098f service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:15.649794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12ee0-7470-4b55-a8d5-4e13e755098f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:15.651359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4de12ee0-7470-4b55-a8d5-4e13e755098f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:15.743184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de12ee0-7470-4b55-a8d5-4e13e755098f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:15.744752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de12ee0-7470-4b55-a8d5-4e13e755098f service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:15.763134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 701/1420] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:16.614362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d6e3-534e-4012-a01c-a9df42abb12a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:16.614844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d6e3-534e-4012-a01c-a9df42abb12a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:16.614950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d6e3-534e-4012-a01c-a9df42abb12a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:16.616260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 720/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:16.621260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c562-9097-4150-ab0d-e6d9920dead7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:16.621730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c562-9097-4150-ab0d-e6d9920dead7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:16.621892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c562-9097-4150-ab0d-e6d9920dead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:16.641302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:16.696496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2cc5c562-9097-4150-ab0d-e6d9920dead7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:16.697718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2cc5c562-9097-4150-ab0d-e6d9920dead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:16.793767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 702/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:16.940542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d6e3-534e-4012-a01c-a9df42abb12a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:16.942091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1439d6e3-534e-4012-a01c-a9df42abb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:17.051025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:17.085958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d6e3-534e-4012-a01c-a9df42abb12a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:17.194512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97b2ec-b5f7-48ad-84d3-43a4ad155bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:17.195036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97b2ec-b5f7-48ad-84d3-43a4ad155bca service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:17.195307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97b2ec-b5f7-48ad-84d3-43a4ad155bca service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:17.195574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97b2ec-b5f7-48ad-84d3-43a4ad155bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:17.197128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fa97b2ec-b5f7-48ad-84d3-43a4ad155bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:17.272167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:17.286306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97b2ec-b5f7-48ad-84d3-43a4ad155bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:17.287982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97b2ec-b5f7-48ad-84d3-43a4ad155bca service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:17.305611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 721/1423] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:18.157045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4190b4-48c2-45e3-a8c1-0891a2b55c1f None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:18.157647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4190b4-48c2-45e3-a8c1-0891a2b55c1f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:18.157647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4190b4-48c2-45e3-a8c1-0891a2b55c1f None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:18.159560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 703/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:18.164532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e9e6-1fbd-4d8e-8ae3-8d3e0caeee7f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:18.164919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e9e6-1fbd-4d8e-8ae3-8d3e0caeee7f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:18.165085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e9e6-1fbd-4d8e-8ae3-8d3e0caeee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:18.245387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6b38e9e6-1fbd-4d8e-8ae3-8d3e0caeee7f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:18.246651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6b38e9e6-1fbd-4d8e-8ae3-8d3e0caeee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:18.342582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 722/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:10:18.493225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4190b4-48c2-45e3-a8c1-0891a2b55c1f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:18.494809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4f4190b4-48c2-45e3-a8c1-0891a2b55c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:18.575999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:18.637778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4190b4-48c2-45e3-a8c1-0891a2b55c1f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:18.747953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b971af7-263e-45a1-9132-798a0a89494a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:18.748470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b971af7-263e-45a1-9132-798a0a89494a service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:18.748741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b971af7-263e-45a1-9132-798a0a89494a service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:18.749003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b971af7-263e-45a1-9132-798a0a89494a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:18.750598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1b971af7-263e-45a1-9132-798a0a89494a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:18.798218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:18.839261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b971af7-263e-45a1-9132-798a0a89494a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:18.840863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b971af7-263e-45a1-9132-798a0a89494a service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:18.858850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 704/1426] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:19.660214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fefe92-205a-44cb-8e77-7fc598836325 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:19.660756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fefe92-205a-44cb-8e77-7fc598836325 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:19.660862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fefe92-205a-44cb-8e77-7fc598836325 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:19.662155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 723/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:19.666979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f363558-c8f2-4594-a372-b29257b7eae5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:19.667439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f363558-c8f2-4594-a372-b29257b7eae5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:19.667542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f363558-c8f2-4594-a372-b29257b7eae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:19.742916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1f363558-c8f2-4594-a372-b29257b7eae5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:19.744125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f363558-c8f2-4594-a372-b29257b7eae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:19.839563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 705/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:10:19.992534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fefe92-205a-44cb-8e77-7fc598836325 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:19.994077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08fefe92-205a-44cb-8e77-7fc598836325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:20.041889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:20.137284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fefe92-205a-44cb-8e77-7fc598836325 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:20.246907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f91c-b876-45d1-a900-b23ea83df6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:20.247503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f91c-b876-45d1-a900-b23ea83df6be service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:20.247780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f91c-b876-45d1-a900-b23ea83df6be service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:20.248052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f91c-b876-45d1-a900-b23ea83df6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:20.249707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5bc8f91c-b876-45d1-a900-b23ea83df6be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:20.256473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:20.338451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8f91c-b876-45d1-a900-b23ea83df6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:20.340046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8f91c-b876-45d1-a900-b23ea83df6be service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:20.359130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 724/1429] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:21.156690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301b2e0-a810-4b61-b1cc-8cb092e382e7 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:21.157273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301b2e0-a810-4b61-b1cc-8cb092e382e7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:21.157273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301b2e0-a810-4b61-b1cc-8cb092e382e7 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:21.158640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 706/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:21.163437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26576867-54f8-4668-878f-2b7d9cd2f9d3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:21.163872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26576867-54f8-4668-878f-2b7d9cd2f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:21.163989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26576867-54f8-4668-878f-2b7d9cd2f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:21.240097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-26576867-54f8-4668-878f-2b7d9cd2f9d3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:21.241221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-26576867-54f8-4668-878f-2b7d9cd2f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:21.307197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:21.336877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 725/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:21.490184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301b2e0-a810-4b61-b1cc-8cb092e382e7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:21.491594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1301b2e0-a810-4b61-b1cc-8cb092e382e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:21.508581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:21.636871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301b2e0-a810-4b61-b1cc-8cb092e382e7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:21.724192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:21.751687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904eb4e-1b6e-4232-afec-18d05f843a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:21.752259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904eb4e-1b6e-4232-afec-18d05f843a86 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:21.752534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904eb4e-1b6e-4232-afec-18d05f843a86 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:21.752802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904eb4e-1b6e-4232-afec-18d05f843a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:21.754415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b904eb4e-1b6e-4232-afec-18d05f843a86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:21.841624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904eb4e-1b6e-4232-afec-18d05f843a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:21.843191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904eb4e-1b6e-4232-afec-18d05f843a86 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:21.861367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 707/1432] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:22.666270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885cd8d-15a1-46f4-9cde-8ad16458c512 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:22.666831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885cd8d-15a1-46f4-9cde-8ad16458c512 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:22.666831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885cd8d-15a1-46f4-9cde-8ad16458c512 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:22.668147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 726/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:22.673111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e57c-ab12-4b0a-b51c-c35778506657 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:22.674059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e57c-ab12-4b0a-b51c-c35778506657 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:22.674211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e57c-ab12-4b0a-b51c-c35778506657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:22.750091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b9d8e57c-ab12-4b0a-b51c-c35778506657 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:22.751300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b9d8e57c-ab12-4b0a-b51c-c35778506657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:22.792239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:22.849787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 708/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:22.998056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885cd8d-15a1-46f4-9cde-8ad16458c512 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:22.999557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3885cd8d-15a1-46f4-9cde-8ad16458c512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:23.141309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885cd8d-15a1-46f4-9cde-8ad16458c512 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:23.194223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:23.251608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80433a-a095-45d3-959d-ed9194496353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:23.252725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80433a-a095-45d3-959d-ed9194496353 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:23.253002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80433a-a095-45d3-959d-ed9194496353 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:23.253269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80433a-a095-45d3-959d-ed9194496353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:23.254878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bf80433a-a095-45d3-959d-ed9194496353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:23.353391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80433a-a095-45d3-959d-ed9194496353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:23.355011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80433a-a095-45d3-959d-ed9194496353 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:23.373353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 727/1435] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:24.187396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec9bfa-25dc-49a9-a2e3-1e50f17311ea None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:24.187926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec9bfa-25dc-49a9-a2e3-1e50f17311ea None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:24.187926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec9bfa-25dc-49a9-a2e3-1e50f17311ea None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:24.189297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 709/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:24.194146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825ce0-85ba-4564-99a8-41161a707552 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:24.194572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825ce0-85ba-4564-99a8-41161a707552 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:24.194690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c825ce0-85ba-4564-99a8-41161a707552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:24.273735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4c825ce0-85ba-4564-99a8-41161a707552 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:24.274956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4c825ce0-85ba-4564-99a8-41161a707552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:24.276954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:24.370070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 728/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:24.518479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec9bfa-25dc-49a9-a2e3-1e50f17311ea None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:24.519924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9fec9bfa-25dc-49a9-a2e3-1e50f17311ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:24.663364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec9bfa-25dc-49a9-a2e3-1e50f17311ea None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:24.689807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:24.775780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681497c0-988e-4011-ade7-77082bb078a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:24.776298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681497c0-988e-4011-ade7-77082bb078a9 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:24.776573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681497c0-988e-4011-ade7-77082bb078a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:24.776841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681497c0-988e-4011-ade7-77082bb078a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:24.778681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-681497c0-988e-4011-ade7-77082bb078a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:24.866671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681497c0-988e-4011-ade7-77082bb078a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:24.868245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681497c0-988e-4011-ade7-77082bb078a9 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:24.886206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 710/1438] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:26.734476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f0f74-da21-4b12-91f9-11f4ac9f85f7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:26.735006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f0f74-da21-4b12-91f9-11f4ac9f85f7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:26.735006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f0f74-da21-4b12-91f9-11f4ac9f85f7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:26.737004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 729/1439] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:10:26.742320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe0ccb-2872-4c19-b899-2035b4ec8d48 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:26.742751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe0ccb-2872-4c19-b899-2035b4ec8d48 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:26.742849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe0ccb-2872-4c19-b899-2035b4ec8d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:26.781986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:26.807686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f2fe0ccb-2872-4c19-b899-2035b4ec8d48 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:26.808871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f2fe0ccb-2872-4c19-b899-2035b4ec8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:26.908669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 711/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:27.192171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f0f74-da21-4b12-91f9-11f4ac9f85f7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:27.193739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-577f0f74-da21-4b12-91f9-11f4ac9f85f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:27.297073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f0f74-da21-4b12-91f9-11f4ac9f85f7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:27.328594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:27.370341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2d8e1-9adc-4519-9d03-e5b1c195898f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:27.370936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d8e1-9adc-4519-9d03-e5b1c195898f service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:27.371212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d8e1-9adc-4519-9d03-e5b1c195898f service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:27.371479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2d8e1-9adc-4519-9d03-e5b1c195898f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:27.373055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-45d2d8e1-9adc-4519-9d03-e5b1c195898f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:27.480109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2d8e1-9adc-4519-9d03-e5b1c195898f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:27.481541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2d8e1-9adc-4519-9d03-e5b1c195898f service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:27.499106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 730/1441] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:29.552570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06a4b-fe0d-4644-b2c3-cc7bacc2f1b9 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:29.553071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06a4b-fe0d-4644-b2c3-cc7bacc2f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:29.553071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06a4b-fe0d-4644-b2c3-cc7bacc2f1b9 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:29.554474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 712/1442] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:29.559865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff1611-0b26-4dc5-8e24-faa7931556cc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:29.560263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff1611-0b26-4dc5-8e24-faa7931556cc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:29.560411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff1611-0b26-4dc5-8e24-faa7931556cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:29.627243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-86ff1611-0b26-4dc5-8e24-faa7931556cc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:29.628442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-86ff1611-0b26-4dc5-8e24-faa7931556cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:29.641116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:29.726934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 731/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:30.020845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06a4b-fe0d-4644-b2c3-cc7bacc2f1b9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:30.022407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-abc06a4b-fe0d-4644-b2c3-cc7bacc2f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:30.123663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06a4b-fe0d-4644-b2c3-cc7bacc2f1b9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:30.136302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:30.197720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1661538-836b-408c-af06-d39fdacd5160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:30.198388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661538-836b-408c-af06-d39fdacd5160 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:30.198705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661538-836b-408c-af06-d39fdacd5160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:30.199015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661538-836b-408c-af06-d39fdacd5160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:30.200631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1661538-836b-408c-af06-d39fdacd5160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:30.326054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1661538-836b-408c-af06-d39fdacd5160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:30.327382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1661538-836b-408c-af06-d39fdacd5160 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:30.344927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 713/1444] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:32.556228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b1fb-8b04-437c-b9c5-0c33aafe8edd None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:32.556821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b1fb-8b04-437c-b9c5-0c33aafe8edd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:32.556821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b1fb-8b04-437c-b9c5-0c33aafe8edd None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:32.558150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 732/1445] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:32.563198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913dde-31c0-4f3b-9545-ba61eeb6c0b5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:32.563625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913dde-31c0-4f3b-9545-ba61eeb6c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:32.563762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9913dde-31c0-4f3b-9545-ba61eeb6c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:32.612615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:32.631231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e9913dde-31c0-4f3b-9545-ba61eeb6c0b5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:32.632472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e9913dde-31c0-4f3b-9545-ba61eeb6c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:32.727555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 714/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:33.014383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00b1fb-8b04-437c-b9c5-0c33aafe8edd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:33.015930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0c00b1fb-8b04-437c-b9c5-0c33aafe8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:33.117792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00b1fb-8b04-437c-b9c5-0c33aafe8edd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:33.156949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:33.191536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cc4dd-e8b4-48b4-bf48-314f320f1c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:33.192052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc4dd-e8b4-48b4-bf48-314f320f1c1a service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:33.192322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc4dd-e8b4-48b4-bf48-314f320f1c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:33.192584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc4dd-e8b4-48b4-bf48-314f320f1c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:33.194189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-343cc4dd-e8b4-48b4-bf48-314f320f1c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:33.299045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cc4dd-e8b4-48b4-bf48-314f320f1c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:33.300454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cc4dd-e8b4-48b4-bf48-314f320f1c1a service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:33.317727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 733/1447] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:35.353448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe5a5-86ad-40b6-b916-9823c597cd02 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:35.354044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe5a5-86ad-40b6-b916-9823c597cd02 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:35.354044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fe5a5-86ad-40b6-b916-9823c597cd02 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:35.355387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 715/1448] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:35.360569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61765152-4002-44ba-a7be-22e457550cd1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:35.361006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61765152-4002-44ba-a7be-22e457550cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:35.361658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61765152-4002-44ba-a7be-22e457550cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:35.426430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-61765152-4002-44ba-a7be-22e457550cd1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:35.427617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-61765152-4002-44ba-a7be-22e457550cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:35.448204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:35.523742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 734/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:35.805640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe5a5-86ad-40b6-b916-9823c597cd02 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:35.807156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c57fe5a5-86ad-40b6-b916-9823c597cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:35.906403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fe5a5-86ad-40b6-b916-9823c597cd02 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:35.927287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:35.982696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d12e2-0b7d-4dee-ad0e-0b5fa5ff7eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:35.983298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d12e2-0b7d-4dee-ad0e-0b5fa5ff7eee service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:35.983575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d12e2-0b7d-4dee-ad0e-0b5fa5ff7eee service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:35.983844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d12e2-0b7d-4dee-ad0e-0b5fa5ff7eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:35.985418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6b1d12e2-0b7d-4dee-ad0e-0b5fa5ff7eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:36.094178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d12e2-0b7d-4dee-ad0e-0b5fa5ff7eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:36.096236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d12e2-0b7d-4dee-ad0e-0b5fa5ff7eee service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:36.113891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 716/1450] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:38.161077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e176-d1a4-496b-978e-9c6f55cd8ab4 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:38.161632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e176-d1a4-496b-978e-9c6f55cd8ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:38.161632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e176-d1a4-496b-978e-9c6f55cd8ab4 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:38.163034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 735/1451] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:38.168174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc54e20-e613-4f33-b87f-3d8111fb5767 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:38.168632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc54e20-e613-4f33-b87f-3d8111fb5767 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:38.168737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc54e20-e613-4f33-b87f-3d8111fb5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:38.232504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:38.235181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0fc54e20-e613-4f33-b87f-3d8111fb5767 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:38.236872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0fc54e20-e613-4f33-b87f-3d8111fb5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:38.331377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 717/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:38.626178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3ca7f-2fef-4cfc-b0f1-593d7f89e018 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:38.626458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3ca7f-2fef-4cfc-b0f1-593d7f89e018 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:38.627413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3ca7f-2fef-4cfc-b0f1-593d7f89e018 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:38.628766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 736/1453] 10.222.0.69 () {54 vars in 965 bytes} [Tue Aug 30 04:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:38.634886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d79d-0a56-4070-97f3-b0a5fa7df189 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:38.635164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d79d-0a56-4070-97f3-b0a5fa7df189 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:38.635427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d79d-0a56-4070-97f3-b0a5fa7df189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:38.709773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2d89d79d-0a56-4070-97f3-b0a5fa7df189 None None] MFA Rules not processed for user `f520107f73aa48f791461922a3d6ec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:38.710987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2d89d79d-0a56-4070-97f3-b0a5fa7df189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:38.815919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:38.822288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 718/1454] 10.222.0.69 () {58 vars in 1062 bytes} [Tue Aug 30 04:10:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:38.831498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3ca7f-2fef-4cfc-b0f1-593d7f89e018 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:38.833075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-efc3ca7f-2fef-4cfc-b0f1-593d7f89e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:38.936531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3ca7f-2fef-4cfc-b0f1-593d7f89e018 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:39.108743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:39.136108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b63db-2ed3-4b4c-afba-25bf7772dd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:39.136703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b63db-2ed3-4b4c-afba-25bf7772dd62 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:39.136981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b63db-2ed3-4b4c-afba-25bf7772dd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:39.137248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b63db-2ed3-4b4c-afba-25bf7772dd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:39.138859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c13b63db-2ed3-4b4c-afba-25bf7772dd62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:39.245155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b63db-2ed3-4b4c-afba-25bf7772dd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:39.246532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b63db-2ed3-4b4c-afba-25bf7772dd62 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:39.264246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 737/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:41.703371 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045555e-02e6-4e6c-8f3f-5d7782180875 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:41.703913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045555e-02e6-4e6c-8f3f-5d7782180875 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:41.704026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045555e-02e6-4e6c-8f3f-5d7782180875 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:41.706152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:41.711433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3c85-93c0-40d1-9e30-79f7a5182d43 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:41.711869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3c85-93c0-40d1-9e30-79f7a5182d43 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:41.711972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3c85-93c0-40d1-9e30-79f7a5182d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:41.778213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-120d3c85-93c0-40d1-9e30-79f7a5182d43 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:41.779418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-120d3c85-93c0-40d1-9e30-79f7a5182d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:41.807744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:41.873814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:42.156661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045555e-02e6-4e6c-8f3f-5d7782180875 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:42.159024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c045555e-02e6-4e6c-8f3f-5d7782180875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:42.261524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045555e-02e6-4e6c-8f3f-5d7782180875 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:42.334961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582992a-6d92-4860-98a1-d2ef90bab9a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:42.335559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582992a-6d92-4860-98a1-d2ef90bab9a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:42.335835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582992a-6d92-4860-98a1-d2ef90bab9a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:42.336101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582992a-6d92-4860-98a1-d2ef90bab9a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:42.337727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0582992a-6d92-4860-98a1-d2ef90bab9a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:42.385906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:42.446011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582992a-6d92-4860-98a1-d2ef90bab9a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:42.447363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582992a-6d92-4860-98a1-d2ef90bab9a3 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:42.465592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 720/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:44.424094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96d77-c7bc-4be0-b334-f700807551c8 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:44.424630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96d77-c7bc-4be0-b334-f700807551c8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:44.424630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd96d77-c7bc-4be0-b334-f700807551c8 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:44.426021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:44.431294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb547-0c43-4156-ae31-36e18d28dcca None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:44.431735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb547-0c43-4156-ae31-36e18d28dcca None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:44.431833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb547-0c43-4156-ae31-36e18d28dcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:44.496769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6b9cb547-0c43-4156-ae31-36e18d28dcca None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:44.497997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6b9cb547-0c43-4156-ae31-36e18d28dcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:44.593899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:44.879374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd96d77-c7bc-4be0-b334-f700807551c8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:44.880907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1dd96d77-c7bc-4be0-b334-f700807551c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:44.985366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd96d77-c7bc-4be0-b334-f700807551c8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:45.042027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:45.059685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3f051-a2ca-4e33-9e2a-5feaa6505607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:45.060275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3f051-a2ca-4e33-9e2a-5feaa6505607 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:45.060547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3f051-a2ca-4e33-9e2a-5feaa6505607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:45.060812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3f051-a2ca-4e33-9e2a-5feaa6505607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:45.062442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9cc3f051-a2ca-4e33-9e2a-5feaa6505607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:45.166987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3f051-a2ca-4e33-9e2a-5feaa6505607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:45.168320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3f051-a2ca-4e33-9e2a-5feaa6505607 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:45.186202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 740/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:47.129566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357db8-f33a-44bb-a594-f3f960610e23 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:47.130092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357db8-f33a-44bb-a594-f3f960610e23 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:47.130092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357db8-f33a-44bb-a594-f3f960610e23 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:47.131466 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:47.136829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5518-de61-4aaf-a3da-e53955fdad14 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:47.137272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5518-de61-4aaf-a3da-e53955fdad14 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:47.137365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f5518-de61-4aaf-a3da-e53955fdad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:47.201998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dc4f5518-de61-4aaf-a3da-e53955fdad14 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:47.203116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dc4f5518-de61-4aaf-a3da-e53955fdad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:47.241147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:47.299612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:10:47.581920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5357db8-f33a-44bb-a594-f3f960610e23 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:47.583482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b5357db8-f33a-44bb-a594-f3f960610e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:47.587334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:47.687367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5357db8-f33a-44bb-a594-f3f960610e23 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:47.761333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9e062-3b36-4ec3-8dbc-b511d471f135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:47.761953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e062-3b36-4ec3-8dbc-b511d471f135 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:47.762226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e062-3b36-4ec3-8dbc-b511d471f135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:47.762488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9e062-3b36-4ec3-8dbc-b511d471f135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:47.764047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-74a9e062-3b36-4ec3-8dbc-b511d471f135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:47.820624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:47.870495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e062-3b36-4ec3-8dbc-b511d471f135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:47.872031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9e062-3b36-4ec3-8dbc-b511d471f135 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:47.890144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 723/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:49.832038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294bce-7663-4471-ba2e-413f93f6b100 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:49.832594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294bce-7663-4471-ba2e-413f93f6b100 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:49.832594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294bce-7663-4471-ba2e-413f93f6b100 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:49.833929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:49.839264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725bba5-a4d6-400a-afc5-3cad5cf90076 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:49.839695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725bba5-a4d6-400a-afc5-3cad5cf90076 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:49.839866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725bba5-a4d6-400a-afc5-3cad5cf90076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:49.906014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f725bba5-a4d6-400a-afc5-3cad5cf90076 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:49.907229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f725bba5-a4d6-400a-afc5-3cad5cf90076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:50.003755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:50.287730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294bce-7663-4471-ba2e-413f93f6b100 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:50.289244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4f294bce-7663-4471-ba2e-413f93f6b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:50.392163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294bce-7663-4471-ba2e-413f93f6b100 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:50.457669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:50.465834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c185fa-1586-4a49-96ce-9418eb1f1bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:50.466531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c185fa-1586-4a49-96ce-9418eb1f1bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:50.466845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c185fa-1586-4a49-96ce-9418eb1f1bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:50.467237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c185fa-1586-4a49-96ce-9418eb1f1bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:50.468872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-40c185fa-1586-4a49-96ce-9418eb1f1bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:50.576087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c185fa-1586-4a49-96ce-9418eb1f1bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:50.577556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c185fa-1586-4a49-96ce-9418eb1f1bd6 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:50.597477 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 743/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:10:52.554717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce80d6-fad5-48ac-8fe2-15e0527a1265 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:52.555312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce80d6-fad5-48ac-8fe2-15e0527a1265 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:52.555312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce80d6-fad5-48ac-8fe2-15e0527a1265 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:52.556612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:10:52.561962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f13a-7c21-4528-bd14-49a944340949 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:52.562376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f13a-7c21-4528-bd14-49a944340949 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:52.562479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f13a-7c21-4528-bd14-49a944340949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:52.627791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7004f13a-7c21-4528-bd14-49a944340949 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:10:52.628966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7004f13a-7c21-4528-bd14-49a944340949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:52.676206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:52.724125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:10:53.014604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce80d6-fad5-48ac-8fe2-15e0527a1265 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:10:53.016178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a8ce80d6-fad5-48ac-8fe2-15e0527a1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:53.030129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:53.118675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce80d6-fad5-48ac-8fe2-15e0527a1265 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:10:53.188637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7c045-e4d7-4858-ba30-44a3b6bbb828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:10:53.189164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7c045-e4d7-4858-ba30-44a3b6bbb828 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:10:53.189978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7c045-e4d7-4858-ba30-44a3b6bbb828 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:10:53.190243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7c045-e4d7-4858-ba30-44a3b6bbb828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:10:53.191796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-04b7c045-e4d7-4858-ba30-44a3b6bbb828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:10:53.258253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:53.299888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7c045-e4d7-4858-ba30-44a3b6bbb828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:10:53.301316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7c045-e4d7-4858-ba30-44a3b6bbb828 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:10:53.319416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 726/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:02.722331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=22 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:03.317246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=25 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:13.690283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a0b06-dbe6-487f-8fb1-9f714b794405 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:13.690840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a0b06-dbe6-487f-8fb1-9f714b794405 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:13.690840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a0b06-dbe6-487f-8fb1-9f714b794405 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:13.692169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 745/1471] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:13.697399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11248da-d9be-4c58-9609-6ae5c4a48ba3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:13.697868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11248da-d9be-4c58-9609-6ae5c4a48ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:13.697983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11248da-d9be-4c58-9609-6ae5c4a48ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:13.763833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f11248da-d9be-4c58-9609-6ae5c4a48ba3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:13.764960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f11248da-d9be-4c58-9609-6ae5c4a48ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:13.860632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 727/1472] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:14.151211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e4c4-8a4c-4123-8ec3-7a91fd247f6f None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:14.151492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e4c4-8a4c-4123-8ec3-7a91fd247f6f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:14.151763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e4c4-8a4c-4123-8ec3-7a91fd247f6f None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:14.153101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 746/1473] 10.222.0.69 () {54 vars in 967 bytes} [Tue Aug 30 04:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:14.157988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ca093-21fb-406c-9e40-61e4da156b52 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:14.158272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ca093-21fb-406c-9e40-61e4da156b52 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:14.158545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ca093-21fb-406c-9e40-61e4da156b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:14.242310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-707ca093-21fb-406c-9e40-61e4da156b52 None None] MFA Rules not processed for user `aa77ec9b56cd4027b22fbe0d7ff3ee1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:14.243518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-707ca093-21fb-406c-9e40-61e4da156b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:14.264206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:14.320568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 728/1474] 10.222.0.69 () {58 vars in 1064 bytes} [Tue Aug 30 04:11:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:14.327990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e4c4-8a4c-4123-8ec3-7a91fd247f6f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:14.329478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-32e1e4c4-8a4c-4123-8ec3-7a91fd247f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:14.430119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e4c4-8a4c-4123-8ec3-7a91fd247f6f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:14.501297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51575b6-cdb5-41fe-8fbc-6dde76323422 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa77ec9b56cd4027b22fbe0d7ff3ee1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:14.501963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51575b6-cdb5-41fe-8fbc-6dde76323422 service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:14.502734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51575b6-cdb5-41fe-8fbc-6dde76323422 service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:14.502996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51575b6-cdb5-41fe-8fbc-6dde76323422 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:14.504560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a51575b6-cdb5-41fe-8fbc-6dde76323422 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:14.559598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:14.630792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51575b6-cdb5-41fe-8fbc-6dde76323422 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:14.632212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51575b6-cdb5-41fe-8fbc-6dde76323422 service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:14.653700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 747/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:16.674478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7780e-6dbb-40ef-8bde-6d068a424a3b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:16.675035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7780e-6dbb-40ef-8bde-6d068a424a3b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:16.675035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7780e-6dbb-40ef-8bde-6d068a424a3b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:16.676337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 729/1476] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:16.681547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95106-82d1-48ac-bb95-7c176faacbdb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:16.681948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95106-82d1-48ac-bb95-7c176faacbdb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:16.682082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95106-82d1-48ac-bb95-7c176faacbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:16.746165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1de95106-82d1-48ac-bb95-7c176faacbdb None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:16.747340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1de95106-82d1-48ac-bb95-7c176faacbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:16.840388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 748/1477] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:17.115332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7780e-6dbb-40ef-8bde-6d068a424a3b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:17.116897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c2c7780e-6dbb-40ef-8bde-6d068a424a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:17.242111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7780e-6dbb-40ef-8bde-6d068a424a3b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:17.290676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:17.335813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964c6fc-4cd0-4521-b803-f65373dcd699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:17.336412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c6fc-4cd0-4521-b803-f65373dcd699 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:17.336687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c6fc-4cd0-4521-b803-f65373dcd699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:17.336958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964c6fc-4cd0-4521-b803-f65373dcd699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:17.337615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964c6fc-4cd0-4521-b803-f65373dcd699 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:17.339399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-c964c6fc-4cd0-4521-b803-f65373dcd699 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:11:17.339399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:11:17.339399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:11:17.340530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964c6fc-4cd0-4521-b803-f65373dcd699 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:17.359050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 730/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 30 04:11:17 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:11:19.276080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174daf5a-9620-4d1c-b8a2-ce90f3896ec0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:19.276605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174daf5a-9620-4d1c-b8a2-ce90f3896ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:19.276605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174daf5a-9620-4d1c-b8a2-ce90f3896ec0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:19.278093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 749/1479] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:19.283392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca368fb-aae4-4f63-8b2e-1d2cff9970a1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:19.283811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca368fb-aae4-4f63-8b2e-1d2cff9970a1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:19.283916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca368fb-aae4-4f63-8b2e-1d2cff9970a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:19.348056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9ca368fb-aae4-4f63-8b2e-1d2cff9970a1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:19.349244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9ca368fb-aae4-4f63-8b2e-1d2cff9970a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:19.442321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 731/1480] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:19.745535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174daf5a-9620-4d1c-b8a2-ce90f3896ec0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:19.747223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-174daf5a-9620-4d1c-b8a2-ce90f3896ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:19.758318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:19.891289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174daf5a-9620-4d1c-b8a2-ce90f3896ec0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:19.969057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:20.002022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a0b38-8b37-41bb-9bbd-a53da62c2b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:20.002616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0b38-8b37-41bb-9bbd-a53da62c2b43 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:20.002893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0b38-8b37-41bb-9bbd-a53da62c2b43 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:20.003662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0b38-8b37-41bb-9bbd-a53da62c2b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:20.005244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aa5a0b38-8b37-41bb-9bbd-a53da62c2b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:20.092766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a0b38-8b37-41bb-9bbd-a53da62c2b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:20.094395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a0b38-8b37-41bb-9bbd-a53da62c2b43 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:20.111784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 750/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:22.166764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b8fe-2864-4fba-9857-2801fea59b7c None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:22.167329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b8fe-2864-4fba-9857-2801fea59b7c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:22.167329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b8fe-2864-4fba-9857-2801fea59b7c None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:22.168569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 732/1482] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:22.173935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728901-d7e6-4378-afe6-5f22fb05285a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:22.174376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728901-d7e6-4378-afe6-5f22fb05285a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:22.174488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728901-d7e6-4378-afe6-5f22fb05285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:22.240408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a0728901-d7e6-4378-afe6-5f22fb05285a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:22.241610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a0728901-d7e6-4378-afe6-5f22fb05285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:22.285480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:22.335235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 751/1483] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:22.625453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6b8fe-2864-4fba-9857-2801fea59b7c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:22.626994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b2c6b8fe-2864-4fba-9857-2801fea59b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:22.650645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:22.730482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6b8fe-2864-4fba-9857-2801fea59b7c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:22.801549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7090ca6-b752-48e9-9e0a-ecb10c856640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:22.802172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090ca6-b752-48e9-9e0a-ecb10c856640 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:22.802449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090ca6-b752-48e9-9e0a-ecb10c856640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:22.802714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7090ca6-b752-48e9-9e0a-ecb10c856640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:22.804279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b7090ca6-b752-48e9-9e0a-ecb10c856640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:22.877074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:22.912307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7090ca6-b752-48e9-9e0a-ecb10c856640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:22.913757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7090ca6-b752-48e9-9e0a-ecb10c856640 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:22.931648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 733/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:24.938774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc2db-126f-4396-a610-5daf77ed252c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:24.939299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc2db-126f-4396-a610-5daf77ed252c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:24.939299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dc2db-126f-4396-a610-5daf77ed252c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:24.940632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 752/1485] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:24.946401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d81c1e-2b1a-47ce-ba4b-0efe3a47b4a1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:24.946824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d81c1e-2b1a-47ce-ba4b-0efe3a47b4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:24.946932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d81c1e-2b1a-47ce-ba4b-0efe3a47b4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:25.013652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-06d81c1e-2b1a-47ce-ba4b-0efe3a47b4a1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:25.014840 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-06d81c1e-2b1a-47ce-ba4b-0efe3a47b4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:25.109180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 734/1486] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:25.399785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc2db-126f-4396-a610-5daf77ed252c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:25.401344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-353dc2db-126f-4396-a610-5daf77ed252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:25.510989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dc2db-126f-4396-a610-5daf77ed252c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:25.582087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:25.584334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b8804-527d-4c30-a545-4c0819010100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:25.585167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b8804-527d-4c30-a545-4c0819010100 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:25.585646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b8804-527d-4c30-a545-4c0819010100 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:25.586232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b8804-527d-4c30-a545-4c0819010100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:25.588134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-501b8804-527d-4c30-a545-4c0819010100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:25.695061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b8804-527d-4c30-a545-4c0819010100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:25.696483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b8804-527d-4c30-a545-4c0819010100 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:25.714145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 753/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:27.779837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e97d1-4eca-4c11-801f-9d96accc7f12 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:27.780401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e97d1-4eca-4c11-801f-9d96accc7f12 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:27.780401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e97d1-4eca-4c11-801f-9d96accc7f12 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:27.781734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 735/1488] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:27.786844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ce54-c519-45d4-94e9-303973059ca2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:27.787277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ce54-c519-45d4-94e9-303973059ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:27.787398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522ce54-c519-45d4-94e9-303973059ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:27.853320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0522ce54-c519-45d4-94e9-303973059ca2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:27.854478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0522ce54-c519-45d4-94e9-303973059ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:27.906885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:27.951097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 754/1489] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:28.240249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e97d1-4eca-4c11-801f-9d96accc7f12 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:28.241816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-dd7e97d1-4eca-4c11-801f-9d96accc7f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:28.276254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:28.342697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e97d1-4eca-4c11-801f-9d96accc7f12 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:28.414628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437f4f2-2953-465b-bd85-fffe16e61d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:28.415226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f4f2-2953-465b-bd85-fffe16e61d4a service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:28.415495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f4f2-2953-465b-bd85-fffe16e61d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:28.415757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f4f2-2953-465b-bd85-fffe16e61d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:28.417330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3437f4f2-2953-465b-bd85-fffe16e61d4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:28.499126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:28.528471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437f4f2-2953-465b-bd85-fffe16e61d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:28.529935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437f4f2-2953-465b-bd85-fffe16e61d4a service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:28.548475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 736/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:30.724550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294a8d-66f1-484a-a29c-2428faf24506 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:30.725155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294a8d-66f1-484a-a29c-2428faf24506 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:30.725155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294a8d-66f1-484a-a29c-2428faf24506 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:30.726450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 755/1491] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 30 04:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:30.731550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fc6bd-3ca3-4810-937c-818ceea3c53c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:30.731990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fc6bd-3ca3-4810-937c-818ceea3c53c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:30.732110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fc6bd-3ca3-4810-937c-818ceea3c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:30.798209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-474fc6bd-3ca3-4810-937c-818ceea3c53c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:30.799415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-474fc6bd-3ca3-4810-937c-818ceea3c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:30.892923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 737/1492] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 30 04:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:31.178977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294a8d-66f1-484a-a29c-2428faf24506 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:31.180560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-44294a8d-66f1-484a-a29c-2428faf24506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:31.282498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294a8d-66f1-484a-a29c-2428faf24506 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:31.354137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528812b-144c-436e-bdb9-0ed4f6f26278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:31.354732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528812b-144c-436e-bdb9-0ed4f6f26278 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:31.355006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528812b-144c-436e-bdb9-0ed4f6f26278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:31.355271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528812b-144c-436e-bdb9-0ed4f6f26278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:31.356845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6528812b-144c-436e-bdb9-0ed4f6f26278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:31.366092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:31.465213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528812b-144c-436e-bdb9-0ed4f6f26278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:31.466588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528812b-144c-436e-bdb9-0ed4f6f26278 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:31.484060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 756/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:40.891387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=82 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:41.481834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=50 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:44.189375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:44.189991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:44.189991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:44.265584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:44.266789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:44.362109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 738/1494] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:12:44.370325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7621-8cc8-4728-bd74-4b2cdb5db713 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:44.370821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7621-8cc8-4728-bd74-4b2cdb5db713 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:44.370937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7621-8cc8-4728-bd74-4b2cdb5db713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:44.446040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dfff7621-8cc8-4728-bd74-4b2cdb5db713 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:44.447162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dfff7621-8cc8-4728-bd74-4b2cdb5db713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:44.542681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 757/1495] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:12:44.547400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:44.548606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:44.560216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feda391-49dc-4612-b22e-5dd4b2c8512b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:44.623333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:44.658145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:44.659059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:44.659334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:44.659602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:44.660239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:12:44.660582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:44.661615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:44.661615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:12:44.661615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:12:44.662488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:44.673564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 739/1496] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:12:44.681751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff7621-8cc8-4728-bd74-4b2cdb5db713 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:44.690696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff7621-8cc8-4728-bd74-4b2cdb5db713 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:44.751694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:44.785475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:44.786108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:44.786364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:44.786627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:44.787239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:44.788957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:44.788957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 30 04:12:44.788957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: Aug 30 04:12:44.790176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:44.846049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 758/1497] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:12:44 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:12:44.850199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:44.851798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:44.884751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dede71-8763-4d64-973c-87a62f0ad136 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:44.975839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:44.976428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:44.976699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:44.976962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:44.977605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:44.978596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:44.978596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:12:44.978596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:12:44.979913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:45.022299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 740/1498] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:12:44 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:12:45.026921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:45.028429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:45.089823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6282e-fc7f-4158-8169-fa9e1d1affaa admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:45.170527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.182320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:45.182919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:45.183189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:45.183456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:45.184082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:45.185066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:45.185066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 30 04:12:45.185066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: Aug 30 04:12:45.185970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:45.198663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 759/1499] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:12:45.202657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:45.204166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:45.215710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3d747-3d05-4a14-aab6-5e7f4ceaed28 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:45.240320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.308734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc128-f53e-4ffe-a140-afffb59e7c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:45.309261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc128-f53e-4ffe-a140-afffb59e7c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:45.309554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc128-f53e-4ffe-a140-afffb59e7c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:45.309824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc128-f53e-4ffe-a140-afffb59e7c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:45.310450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc128-f53e-4ffe-a140-afffb59e7c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:45.311442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-1a3cc128-f53e-4ffe-a140-afffb59e7c28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:45.311442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:12:45.311442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:12:45.312308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc128-f53e-4ffe-a140-afffb59e7c28 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:45.324851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 741/1500] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:12:45.328992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:45.330520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:45.363338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225fc8c-4260-4067-a75b-666f29bc4fb6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:45.454072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9b8a4-2d68-4f08-bc77-3eafea57e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:45.454715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9b8a4-2d68-4f08-bc77-3eafea57e9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:45.454989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9b8a4-2d68-4f08-bc77-3eafea57e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:45.455252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9b8a4-2d68-4f08-bc77-3eafea57e9d8 admin admin] PATH_INFO: `/v3/projects/68209ad52d6c4f5fb75c7a9ad7afe497/users/5e74187dbed44c1d800805298eee5b98/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:45.476972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9b8a4-2d68-4f08-bc77-3eafea57e9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68209ad52d6c4f5fb75c7a9ad7afe497, user_id=5e74187dbed44c1d800805298eee5b98, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:45.478001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-c5e9b8a4-2d68-4f08-bc77-3eafea57e9d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:45.478001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 30 04:12:45.478001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: Aug 30 04:12:45.479928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9b8a4-2d68-4f08-bc77-3eafea57e9d8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:45.504215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 760/1501] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:12:45 2022] PUT /identity/v3/projects/68209ad52d6c4f5fb75c7a9ad7afe497/users/5e74187dbed44c1d800805298eee5b98/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:12:45.516468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc2f9f-5411-4f57-9667-338af06beaeb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:45.516758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc2f9f-5411-4f57-9667-338af06beaeb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:45.517034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc2f9f-5411-4f57-9667-338af06beaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:45.573107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e4dc2f9f-5411-4f57-9667-338af06beaeb None None] MFA Rules not processed for user `5e74187dbed44c1d800805298eee5b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:45.574275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e4dc2f9f-5411-4f57-9667-338af06beaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:45.653056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 742/1502] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:12:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:12:45.666917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9a239-37e4-4c05-bd1c-09d46287857e None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:45.667201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9a239-37e4-4c05-bd1c-09d46287857e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:45.667473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9a239-37e4-4c05-bd1c-09d46287857e None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:45.668811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 761/1503] 10.222.0.69 () {54 vars in 964 bytes} [Tue Aug 30 04:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:12:45.673714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf6cdb-f4b6-408e-a83e-d3421d9b0606 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:45.673996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf6cdb-f4b6-408e-a83e-d3421d9b0606 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:45.674264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf6cdb-f4b6-408e-a83e-d3421d9b0606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:45.705082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.750417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7bbf6cdb-f4b6-408e-a83e-d3421d9b0606 None None] MFA Rules not processed for user `94e017d6c128460eb8506dfb32697f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:45.751610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7bbf6cdb-f4b6-408e-a83e-d3421d9b0606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:45.827348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 743/1504] 10.222.0.69 () {58 vars in 1061 bytes} [Tue Aug 30 04:12:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:12:45.835839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9a239-37e4-4c05-bd1c-09d46287857e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:45.837367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a3e9a239-37e4-4c05-bd1c-09d46287857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:45.887965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.941760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9a239-37e4-4c05-bd1c-09d46287857e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:46.014694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:46.015291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:46.015564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:46.015830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:46.017419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:46.123758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:46.125187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:46.128752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:46.144844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 762/1505] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:12:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:46.189989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebdbad-321c-4a14-94f8-da05a18c6bda None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:46.190272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebdbad-321c-4a14-94f8-da05a18c6bda None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:46.190543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebdbad-321c-4a14-94f8-da05a18c6bda None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:46.192304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 744/1506] 10.222.0.69 () {52 vars in 830 bytes} [Tue Aug 30 04:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:12:46.195860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:46.197115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:46.295204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23cf4-f02a-4547-b283-81f08b62a68b service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:46.388635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:46.389178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:46.389451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:46.389770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] PATH_INFO: `/v3/users/5e74187dbed44c1d800805298eee5b98` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:46.402196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e74187dbed44c1d800805298eee5b98)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:46.403203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:46.403203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 30 04:12:46.403203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: Aug 30 04:12:46.404399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:46.413893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:46.472004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e74187dbed44c1d800805298eee5b98'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:46.472766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e74187dbed44c1d800805298eee5b98'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:46.497905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e74187dbed44c1d800805298eee5b98'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:46.511955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e74187dbed44c1d800805298eee5b98'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:46.512524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e74187dbed44c1d800805298eee5b98'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:46.527023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 763/1507] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:12:46 2022] DELETE /identity/v3/users/5e74187dbed44c1d800805298eee5b98 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:12:46.531374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:46.531826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:46.532017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:46.589891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:46.591097 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:46.664753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:46.677783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 745/1508] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:12:46.691971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:46.693195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:46.791541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e44ac2-8474-40bb-8004-f9314d3ece39 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:46.844724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:46.865749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364ed3-650d-45c2-b878-e968e40f44bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:46.866354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364ed3-650d-45c2-b878-e968e40f44bf service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:46.866630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364ed3-650d-45c2-b878-e968e40f44bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:46.866898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364ed3-650d-45c2-b878-e968e40f44bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:46.868454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7e364ed3-650d-45c2-b878-e968e40f44bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:46.972758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364ed3-650d-45c2-b878-e968e40f44bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:46.974919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364ed3-650d-45c2-b878-e968e40f44bf service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:46.993952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 764/1509] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:47.334432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:47.335765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:47.347166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f57e29-76d0-4ee1-9482-a97de74f1d63 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:47.445017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:47.445671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:47.445944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:47.446211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] PATH_INFO: `/v3/projects/68209ad52d6c4f5fb75c7a9ad7afe497` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:47.456063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68209ad52d6c4f5fb75c7a9ad7afe497)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:47.457089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:12:47.457089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:12:47.457089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:12:47.459076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:47.522372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68209ad52d6c4f5fb75c7a9ad7afe497', 'request_id': 'req-847810c9-52ba-4373-aa47-9ca3cd52c157'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:47.538040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68209ad52d6c4f5fb75c7a9ad7afe497', 'request_id': 'req-847810c9-52ba-4373-aa47-9ca3cd52c157'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:47.546935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68209ad52d6c4f5fb75c7a9ad7afe497', 'request_id': 'req-847810c9-52ba-4373-aa47-9ca3cd52c157'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:47.587956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] The token cache is being invalidate because project 68209ad52d6c4f5fb75c7a9ad7afe497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:12:47.588246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:47.588780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-847810c9-52ba-4373-aa47-9ca3cd52c157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:12:47.590413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 746/1510] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:47 2022] DELETE /identity/v3/projects/68209ad52d6c4f5fb75c7a9ad7afe497 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:12:56.991679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=62 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:57.585888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:21.644206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becb10-2e7f-4a0d-af4f-fc732166ab0a None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.644760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becb10-2e7f-4a0d-af4f-fc732166ab0a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.644760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becb10-2e7f-4a0d-af4f-fc732166ab0a None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.646129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:21.651492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8e8e-d743-42de-a942-20057280f902 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.651934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8e8e-d743-42de-a942-20057280f902 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.652039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8e8e-d743-42de-a942-20057280f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.732061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f1eb8e8e-d743-42de-a942-20057280f902 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:21.733279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1eb8e8e-d743-42de-a942-20057280f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:21.839555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:21.995857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becb10-2e7f-4a0d-af4f-fc732166ab0a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.997997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e3becb10-2e7f-4a0d-af4f-fc732166ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:22.114755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becb10-2e7f-4a0d-af4f-fc732166ab0a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.120829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cefc7c-7ced-4e91-92c4-383f4ac7f5b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.121425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cefc7c-7ced-4e91-92c4-383f4ac7f5b8 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.121736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cefc7c-7ced-4e91-92c4-383f4ac7f5b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.122010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cefc7c-7ced-4e91-92c4-383f4ac7f5b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.129937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cefc7c-7ced-4e91-92c4-383f4ac7f5b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.131489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cefc7c-7ced-4e91-92c4-383f4ac7f5b8 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.140619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 766/1513] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:22.974904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bff2e1-3be6-4451-8aa6-1006e2d01396 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.975430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bff2e1-3be6-4451-8aa6-1006e2d01396 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.975430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bff2e1-3be6-4451-8aa6-1006e2d01396 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.977233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:22.982196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc52b-4626-4b4b-9de0-5dc174022a19 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.982623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc52b-4626-4b4b-9de0-5dc174022a19 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.982747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc52b-4626-4b4b-9de0-5dc174022a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.004660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-555cc52b-4626-4b4b-9de0-5dc174022a19 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:23.005893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-555cc52b-4626-4b4b-9de0-5dc174022a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.013746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:23.165972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bff2e1-3be6-4451-8aa6-1006e2d01396 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:23.180238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bff2e1-3be6-4451-8aa6-1006e2d01396 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:23.185541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271e6bb-6bc4-46ee-b933-84ee602284a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:23.186128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271e6bb-6bc4-46ee-b933-84ee602284a5 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.186469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271e6bb-6bc4-46ee-b933-84ee602284a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.186664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271e6bb-6bc4-46ee-b933-84ee602284a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.194626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271e6bb-6bc4-46ee-b933-84ee602284a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:23.196197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271e6bb-6bc4-46ee-b933-84ee602284a5 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:23.205317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 749/1516] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:23.636841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd463c3-4516-4648-9687-a2cb73c2eb56 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.637127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd463c3-4516-4648-9687-a2cb73c2eb56 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.637427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd463c3-4516-4648-9687-a2cb73c2eb56 None None] PATH_INFO: `/v3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.638742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 768/1517] 10.222.0.60 () {54 vars in 925 bytes} [Tue Aug 30 04:14:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:23.644977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfbf3-1c31-4c4b-a5ad-963273553fd9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.645260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfbf3-1c31-4c4b-a5ad-963273553fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.645667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfbf3-1c31-4c4b-a5ad-963273553fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.705463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0e3dfbf3-1c31-4c4b-a5ad-963273553fd9 None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:23.706702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0e3dfbf3-1c31-4c4b-a5ad-963273553fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.723772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:23.778670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 750/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 30 04:14:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:32.706186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31ed3-57f9-4a20-b1f9-8e82b7543ed2 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.706735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31ed3-57f9-4a20-b1f9-8e82b7543ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.706735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31ed3-57f9-4a20-b1f9-8e82b7543ed2 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.708027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 769/1519] 10.222.0.69 () {54 vars in 961 bytes} [Tue Aug 30 04:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:32.713127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0170c11-f2f9-4447-9304-e6fe79dd7581 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.713566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0170c11-f2f9-4447-9304-e6fe79dd7581 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.713694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0170c11-f2f9-4447-9304-e6fe79dd7581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.733148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b0170c11-f2f9-4447-9304-e6fe79dd7581 None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:32.734365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b0170c11-f2f9-4447-9304-e6fe79dd7581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:32.743856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 751/1520] 10.222.0.69 () {58 vars in 1058 bytes} [Tue Aug 30 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:32.751346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31ed3-57f9-4a20-b1f9-8e82b7543ed2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.764644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31ed3-57f9-4a20-b1f9-8e82b7543ed2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.769503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adee8bc-1dfc-4ec9-9523-6fa303cb7a14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.770144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adee8bc-1dfc-4ec9-9523-6fa303cb7a14 service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.770422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adee8bc-1dfc-4ec9-9523-6fa303cb7a14 service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.770693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adee8bc-1dfc-4ec9-9523-6fa303cb7a14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.778721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adee8bc-1dfc-4ec9-9523-6fa303cb7a14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.780271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adee8bc-1dfc-4ec9-9523-6fa303cb7a14 service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.790241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 770/1521] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:34.429739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fe6d-307b-49a2-b28c-596ad22634df None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.430320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fe6d-307b-49a2-b28c-596ad22634df None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.430320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fe6d-307b-49a2-b28c-596ad22634df None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.431685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:34.436511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41cb64-8c69-4bbc-bcf9-c6e0ae143a8f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.436906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41cb64-8c69-4bbc-bcf9-c6e0ae143a8f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.437106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41cb64-8c69-4bbc-bcf9-c6e0ae143a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.455921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dd41cb64-8c69-4bbc-bcf9-c6e0ae143a8f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:34.457107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dd41cb64-8c69-4bbc-bcf9-c6e0ae143a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:34.465378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:34.622266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fe6d-307b-49a2-b28c-596ad22634df None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.636709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fe6d-307b-49a2-b28c-596ad22634df None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.642245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c937faf-e291-4dea-aa05-d36aa60c9317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.642832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937faf-e291-4dea-aa05-d36aa60c9317 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.643112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937faf-e291-4dea-aa05-d36aa60c9317 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.643383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c937faf-e291-4dea-aa05-d36aa60c9317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.651956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c937faf-e291-4dea-aa05-d36aa60c9317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.653562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c937faf-e291-4dea-aa05-d36aa60c9317 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.662821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 753/1524] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:35.481073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db93d-497a-495e-8344-cab076337faa None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.481660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db93d-497a-495e-8344-cab076337faa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.481660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db93d-497a-495e-8344-cab076337faa None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.482997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:35.487620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffb86c-e985-4f56-998b-c413afa5e845 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.488022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffb86c-e985-4f56-998b-c413afa5e845 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.488161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffb86c-e985-4f56-998b-c413afa5e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.508144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3bffb86c-e985-4f56-998b-c413afa5e845 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:35.509330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3bffb86c-e985-4f56-998b-c413afa5e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:35.517071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:35.667544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48db93d-497a-495e-8344-cab076337faa None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.682309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48db93d-497a-495e-8344-cab076337faa None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.687769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bc0f7-6aa6-4e3f-bff4-09ec164b8dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.688349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc0f7-6aa6-4e3f-bff4-09ec164b8dd3 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.688625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc0f7-6aa6-4e3f-bff4-09ec164b8dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.688896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc0f7-6aa6-4e3f-bff4-09ec164b8dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.696786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bc0f7-6aa6-4e3f-bff4-09ec164b8dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.698372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bc0f7-6aa6-4e3f-bff4-09ec164b8dd3 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.707448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 773/1527] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:39.560899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fe934-5f9d-4962-b14a-e22876ba2065 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.561487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fe934-5f9d-4962-b14a-e22876ba2065 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.561487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fe934-5f9d-4962-b14a-e22876ba2065 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.562817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:39.567922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360bbd-1927-4f08-a3a2-dfb9ed415dcd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.568373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360bbd-1927-4f08-a3a2-dfb9ed415dcd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.568478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360bbd-1927-4f08-a3a2-dfb9ed415dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.589110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cd360bbd-1927-4f08-a3a2-dfb9ed415dcd None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:39.590352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cd360bbd-1927-4f08-a3a2-dfb9ed415dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:39.599844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:39.887043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fe934-5f9d-4962-b14a-e22876ba2065 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.888752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-277fe934-5f9d-4962-b14a-e22876ba2065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:39.966614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fe934-5f9d-4962-b14a-e22876ba2065 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.970219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfed732-446f-42e0-a2fe-9a0da08534dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.970815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed732-446f-42e0-a2fe-9a0da08534dd service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.971093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed732-446f-42e0-a2fe-9a0da08534dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.971362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed732-446f-42e0-a2fe-9a0da08534dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.980664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfed732-446f-42e0-a2fe-9a0da08534dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.982475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfed732-446f-42e0-a2fe-9a0da08534dd service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.991817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 756/1530] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:41.907187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c53bf-b463-42e4-b8d4-f2c501bb5432 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.907712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c53bf-b463-42e4-b8d4-f2c501bb5432 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.907712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c53bf-b463-42e4-b8d4-f2c501bb5432 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.909008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:41.914209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ac22-7c2a-49f3-8a4f-9472052f6469 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.914607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ac22-7c2a-49f3-8a4f-9472052f6469 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.914759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960ac22-7c2a-49f3-8a4f-9472052f6469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.935877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2960ac22-7c2a-49f3-8a4f-9472052f6469 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:41.937111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2960ac22-7c2a-49f3-8a4f-9472052f6469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:41.945428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:42.237414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c53bf-b463-42e4-b8d4-f2c501bb5432 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.239143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3f5c53bf-b463-42e4-b8d4-f2c501bb5432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:42.252488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c53bf-b463-42e4-b8d4-f2c501bb5432 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.255931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5f77b-3a01-4a3f-85e3-f6f5f16fe900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.256511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f77b-3a01-4a3f-85e3-f6f5f16fe900 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.257436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f77b-3a01-4a3f-85e3-f6f5f16fe900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.257731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f77b-3a01-4a3f-85e3-f6f5f16fe900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.267247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5f77b-3a01-4a3f-85e3-f6f5f16fe900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.268638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5f77b-3a01-4a3f-85e3-f6f5f16fe900 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.277757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 776/1533] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:45.713623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15073-2fbf-4735-a0da-fe9f5d981949 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.714154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15073-2fbf-4735-a0da-fe9f5d981949 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.714268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15073-2fbf-4735-a0da-fe9f5d981949 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.715592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:45.720612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36b21-b7cb-489d-a784-b3c631343998 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.721023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36b21-b7cb-489d-a784-b3c631343998 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.721164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36b21-b7cb-489d-a784-b3c631343998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.740240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-46f36b21-b7cb-489d-a784-b3c631343998 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:45.741971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-46f36b21-b7cb-489d-a784-b3c631343998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.749710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:46.305847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba15073-2fbf-4735-a0da-fe9f5d981949 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.307565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2ba15073-2fbf-4735-a0da-fe9f5d981949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:46.491565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.504681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba15073-2fbf-4735-a0da-fe9f5d981949 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.508199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8007603-4c4b-4864-9dcf-9f2262af95b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.508799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8007603-4c4b-4864-9dcf-9f2262af95b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.509071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8007603-4c4b-4864-9dcf-9f2262af95b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.509331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8007603-4c4b-4864-9dcf-9f2262af95b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.518912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8007603-4c4b-4864-9dcf-9f2262af95b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.520350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8007603-4c4b-4864-9dcf-9f2262af95b9 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.531971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 759/1536] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:48.448705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1918cc-83db-4905-9977-f62f8158a5a1 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.449312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1918cc-83db-4905-9977-f62f8158a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.449312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1918cc-83db-4905-9977-f62f8158a5a1 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.450632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:48.455665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3209f48-fc1b-4ae2-ae61-76e6d0ad732e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.456087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3209f48-fc1b-4ae2-ae61-76e6d0ad732e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.456204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3209f48-fc1b-4ae2-ae61-76e6d0ad732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.475750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b3209f48-fc1b-4ae2-ae61-76e6d0ad732e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:48.476942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b3209f48-fc1b-4ae2-ae61-76e6d0ad732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:48.484648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:49.035941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1918cc-83db-4905-9977-f62f8158a5a1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.038168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1a1918cc-83db-4905-9977-f62f8158a5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.045676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=84 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.051950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1918cc-83db-4905-9977-f62f8158a5a1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.056032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a75d5d-ef10-4eb2-bd2a-d70c237486b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.056611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75d5d-ef10-4eb2-bd2a-d70c237486b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.056885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75d5d-ef10-4eb2-bd2a-d70c237486b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.057152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75d5d-ef10-4eb2-bd2a-d70c237486b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.065767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a75d5d-ef10-4eb2-bd2a-d70c237486b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.067190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a75d5d-ef10-4eb2-bd2a-d70c237486b3 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.076512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 779/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:58.470469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=11 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:59.072326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:15.681288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cde96-4c69-4b72-ba6e-b34cbeae043e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.685308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cde96-4c69-4b72-ba6e-b34cbeae043e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.685308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cde96-4c69-4b72-ba6e-b34cbeae043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.712312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-759cde96-4c69-4b72-ba6e-b34cbeae043e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:15.713563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-759cde96-4c69-4b72-ba6e-b34cbeae043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:15.724797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 761/1540] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:15.734665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756fe67-0d08-426e-828e-83e29487aa77 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.735822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756fe67-0d08-426e-828e-83e29487aa77 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.736333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756fe67-0d08-426e-828e-83e29487aa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.774933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7756fe67-0d08-426e-828e-83e29487aa77 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:15.776744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7756fe67-0d08-426e-828e-83e29487aa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:15.785860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 780/1541] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:15.791365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cde96-4c69-4b72-ba6e-b34cbeae043e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:15.811229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cde96-4c69-4b72-ba6e-b34cbeae043e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:15.821628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:15.822328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.822605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.823013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.823671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:15.823970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:15.825610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:15.830019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d420f6-b994-45f4-8faf-51ded3bfd1c7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.830329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d420f6-b994-45f4-8faf-51ded3bfd1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.830563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d420f6-b994-45f4-8faf-51ded3bfd1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.841081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 762/1542] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:15.851420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:15.863609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-33d420f6-b994-45f4-8faf-51ded3bfd1c7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:15.865636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fac59-343c-48d6-bc9e-d0cf80d5525b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:15.873551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-33d420f6-b994-45f4-8faf-51ded3bfd1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:15.879647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f405bb-a5f5-48b4-837b-14dbbee9f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:15.881226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f405bb-a5f5-48b4-837b-14dbbee9f06a admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.881767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f405bb-a5f5-48b4-837b-14dbbee9f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.882268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f405bb-a5f5-48b4-837b-14dbbee9f06a admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.883184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f405bb-a5f5-48b4-837b-14dbbee9f06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:15.884616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-c0f405bb-a5f5-48b4-837b-14dbbee9f06a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:16:15.884616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:16:15.884616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:16:15.886458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f405bb-a5f5-48b4-837b-14dbbee9f06a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:15.893605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 781/1543] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:15.893605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b0b2-9185-482c-942f-d67b6dd7f9ef None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.893605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b0b2-9185-482c-942f-d67b6dd7f9ef None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.893605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b0b2-9185-482c-942f-d67b6dd7f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.948112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a680b0b2-9185-482c-942f-d67b6dd7f9ef None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:15.954278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a680b0b2-9185-482c-942f-d67b6dd7f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:15.963955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 763/1544] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:15 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:15.966258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9af6b5-3667-43d1-ba4c-ee9617abf199 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.966798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9af6b5-3667-43d1-ba4c-ee9617abf199 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.967693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9af6b5-3667-43d1-ba4c-ee9617abf199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.968566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 782/1545] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:15.975513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562c89-4094-4487-891a-6ea6f635320c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.975813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562c89-4094-4487-891a-6ea6f635320c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.976054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef562c89-4094-4487-891a-6ea6f635320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.023417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ef562c89-4094-4487-891a-6ea6f635320c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.024641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ef562c89-4094-4487-891a-6ea6f635320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.030704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ef9af6b5-3667-43d1-ba4c-ee9617abf199 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.031879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ef9af6b5-3667-43d1-ba4c-ee9617abf199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.136356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 764/1546] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.136356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9af6b5-3667-43d1-ba4c-ee9617abf199 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.149540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9af6b5-3667-43d1-ba4c-ee9617abf199 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.154713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16777624-baa7-410b-86e2-de2a99586562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.155325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16777624-baa7-410b-86e2-de2a99586562 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.155603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16777624-baa7-410b-86e2-de2a99586562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.155873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16777624-baa7-410b-86e2-de2a99586562 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.156515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16777624-baa7-410b-86e2-de2a99586562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.158453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16777624-baa7-410b-86e2-de2a99586562 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.164979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 783/1547] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:16.173004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80b7a7-b8c3-44dd-84b2-58e67d51b049 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.173004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80b7a7-b8c3-44dd-84b2-58e67d51b049 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.173004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80b7a7-b8c3-44dd-84b2-58e67d51b049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.181938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 765/1548] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.183578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf252-e736-4067-b62a-287966b68f71 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.183578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf252-e736-4067-b62a-287966b68f71 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.183815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf252-e736-4067-b62a-287966b68f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.190860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cf80b7a7-b8c3-44dd-84b2-58e67d51b049 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.192297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cf80b7a7-b8c3-44dd-84b2-58e67d51b049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.200297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 784/1549] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.201570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741abe9-f5d5-4129-b61c-8e47e1563b89 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.201846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741abe9-f5d5-4129-b61c-8e47e1563b89 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.202109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741abe9-f5d5-4129-b61c-8e47e1563b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.203027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-62ddf252-e736-4067-b62a-287966b68f71 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.204228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-62ddf252-e736-4067-b62a-287966b68f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.212411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 766/1550] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.213698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfee35-ec74-4eb8-8bd8-347d4e295647 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.213908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfee35-ec74-4eb8-8bd8-347d4e295647 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.214162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfee35-ec74-4eb8-8bd8-347d4e295647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.222013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c741abe9-f5d5-4129-b61c-8e47e1563b89 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.223190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c741abe9-f5d5-4129-b61c-8e47e1563b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.231540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 785/1551] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.232324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741abe9-f5d5-4129-b61c-8e47e1563b89 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.239488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-77cfee35-ec74-4eb8-8bd8-347d4e295647 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.241383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-77cfee35-ec74-4eb8-8bd8-347d4e295647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.242267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741abe9-f5d5-4129-b61c-8e47e1563b89 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.246879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.247461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.247740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.248012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.248644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:16.248943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.249677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 767/1552] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.249981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:16:16.249981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 30 04:16:16.249981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: Aug 30 04:16:16.250848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffbe85-3c85-4b9b-bb9a-2e34aa5dcd27 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.251033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051bab3-c597-4754-8238-9a7969d6fc1b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.251282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051bab3-c597-4754-8238-9a7969d6fc1b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.251552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051bab3-c597-4754-8238-9a7969d6fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.265101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 786/1553] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:16.266457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0eb81-f56d-4656-9486-8bedc92b6429 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.266760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0eb81-f56d-4656-9486-8bedc92b6429 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.267056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0eb81-f56d-4656-9486-8bedc92b6429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.275599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f051bab3-c597-4754-8238-9a7969d6fc1b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.276958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f051bab3-c597-4754-8238-9a7969d6fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.285124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 768/1554] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.285963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051bab3-c597-4754-8238-9a7969d6fc1b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.290975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-88b0eb81-f56d-4656-9486-8bedc92b6429 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.292394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-88b0eb81-f56d-4656-9486-8bedc92b6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.300254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051bab3-c597-4754-8238-9a7969d6fc1b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.301437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 787/1555] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.302941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0eb81-f56d-4656-9486-8bedc92b6429 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.306010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba389bac-e1a3-430b-89bd-e7c4e5d1cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.306605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba389bac-e1a3-430b-89bd-e7c4e5d1cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.306875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba389bac-e1a3-430b-89bd-e7c4e5d1cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.307137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba389bac-e1a3-430b-89bd-e7c4e5d1cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.307763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba389bac-e1a3-430b-89bd-e7c4e5d1cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.309351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba389bac-e1a3-430b-89bd-e7c4e5d1cc28 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.312288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0eb81-f56d-4656-9486-8bedc92b6429 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.317012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfee81-b721-47d0-aa91-fcad7beae904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.317650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfee81-b721-47d0-aa91-fcad7beae904 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.317932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfee81-b721-47d0-aa91-fcad7beae904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.318204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfee81-b721-47d0-aa91-fcad7beae904 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.318837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfee81-b721-47d0-aa91-fcad7beae904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:16.319167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfee81-b721-47d0-aa91-fcad7beae904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.320149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 769/1556] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:16.320732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfee81-b721-47d0-aa91-fcad7beae904 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.321464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2108-fd08-4201-b82f-7b0a6d43b51e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.321765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2108-fd08-4201-b82f-7b0a6d43b51e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.322033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2108-fd08-4201-b82f-7b0a6d43b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.340032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 788/1557] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:16.340032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401120f-a381-482e-a76a-2203ad6c1dad None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.340032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401120f-a381-482e-a76a-2203ad6c1dad None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.340032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401120f-a381-482e-a76a-2203ad6c1dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.346461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-027f2108-fd08-4201-b82f-7b0a6d43b51e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.347662 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-027f2108-fd08-4201-b82f-7b0a6d43b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.355070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9401120f-a381-482e-a76a-2203ad6c1dad None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.356158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 770/1558] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.356287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9401120f-a381-482e-a76a-2203ad6c1dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.357299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6632-e9f5-43dd-a883-2af027fd1060 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.357611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6632-e9f5-43dd-a883-2af027fd1060 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.357878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6632-e9f5-43dd-a883-2af027fd1060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.366491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 789/1559] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.367186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401120f-a381-482e-a76a-2203ad6c1dad None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.376277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401120f-a381-482e-a76a-2203ad6c1dad None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.377735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-30eb6632-e9f5-43dd-a883-2af027fd1060 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.378909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-30eb6632-e9f5-43dd-a883-2af027fd1060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.380809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.381390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.381695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.381956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.382582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.384433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.387083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 771/1560] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.388312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fde9b-1724-49f1-b40f-99ef4d2e4f65 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.388591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fde9b-1724-49f1-b40f-99ef4d2e4f65 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.388977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fde9b-1724-49f1-b40f-99ef4d2e4f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.410262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b18fde9b-1724-49f1-b40f-99ef4d2e4f65 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.411988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b18fde9b-1724-49f1-b40f-99ef4d2e4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.418174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 790/1561] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.418174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.454377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.471522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 772/1562] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:16.472423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fde9b-1724-49f1-b40f-99ef4d2e4f65 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.479816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b074-3847-474d-a8f0-6d0ec1dc9a0f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.481922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fde9b-1724-49f1-b40f-99ef4d2e4f65 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.484568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.485266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.485568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.485885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.486649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:16.486941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.487199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.487793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.488064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.488354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.488633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.488979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.490587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.497209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.508529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 791/1563] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:16.508736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 773/1564] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:16.508852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.508946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.512883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac4c8d-4500-46ab-807f-b930bb7f9daa admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.516327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16382f-97de-4b37-be2f-9cfdae46dbb1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.517475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.518089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.518365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.518634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.519254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.521425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.521658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.522034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.522355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.522625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.523330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:16.523733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.525306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.537737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 774/1565] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:16.538896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.549987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a0f89-26c6-412e-a0e0-c4c45267ce31 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.553654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 792/1566] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.554479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.554760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.555352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.555653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.555924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.556564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:16.557102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.558845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.571008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 775/1567] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:16.571823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.581836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f321a22-cac7-42f5-a5bf-7abb6933d075 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.625455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ae0b7-36d7-4c01-bab5-0188f9482fbd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.630727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.631354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.631698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.631971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.632626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:16.632925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.634565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.643865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.644696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.644976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.645386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.646605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.646990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 793/1568] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:16.647823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.648625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.657906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f24df-c90a-4fd8-8e57-1830b85977a0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.664904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.665800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.666106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.666335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.667062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:16.667410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.669086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.675385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 776/1569] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.676335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.687201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 794/1570] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:16.687445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6d4e-c35e-4b11-ac84-718dd2b791b5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.688393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.692529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.693146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.693427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.693727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.694786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.696995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.700230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0560-9899-4c74-a304-53394e9bf061 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.705087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.705771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.706064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.706345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] PATH_INFO: `/v3/projects/115fc067003a4b87ba0148d9f21a394b/users/3f3adca148414dc9a28f20e37dbe6fba/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.722835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115fc067003a4b87ba0148d9f21a394b, user_id=3f3adca148414dc9a28f20e37dbe6fba, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.726072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.726259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 777/1571] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.727195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.743291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 795/1572] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:16 2022] PUT /identity/v3/projects/115fc067003a4b87ba0148d9f21a394b/users/3f3adca148414dc9a28f20e37dbe6fba/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:16.744147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.798753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5fae2-e83e-478c-a0b2-c665f26b2b75 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.803454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.804056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.804333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.804606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.805231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.805816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b12574-45fc-423c-9179-4c8443a3dee3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.807168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.810495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.811084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.811470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.811745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.812514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.813528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:16:16.813528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 30 04:16:16.813528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: Aug 30 04:16:16.814714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.835697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 778/1573] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.836658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.841610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 796/1574] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.841610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.845118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.849391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ccad-0eeb-4ffe-81c3-da800bed403f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.869937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.902954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7cfcd-78e8-4a72-befc-89955b935b23 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.907460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.908004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.908130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.908323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.908592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.908704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.908865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.909132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.909233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.909775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.911135 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.911647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.937811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 797/1575] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.942069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 779/1576] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:16.942069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.942327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.002876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04492f5a-df02-4e5d-b88b-4f2d711734d9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.003196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c403-3cba-4f85-82f4-81ae8d6993bc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.008214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0573149-6a32-46b7-97d7-19f657bd0f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.009241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.009987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0573149-6a32-46b7-97d7-19f657bd0f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.010265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0573149-6a32-46b7-97d7-19f657bd0f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.010538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0573149-6a32-46b7-97d7-19f657bd0f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.011172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0573149-6a32-46b7-97d7-19f657bd0f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.011881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.012163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.013663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.014336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0573149-6a32-46b7-97d7-19f657bd0f51 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.014456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.015951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.027528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 780/1577] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.028355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.038371 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811da8c-d9c8-4024-9d8e-f11335e29ea3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.043104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.043688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.043965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.044235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.044855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.046004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 798/1578] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.046797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.047229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083eebf-55bf-4c3f-ad78-1291e6c0d3cc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.047509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083eebf-55bf-4c3f-ad78-1291e6c0d3cc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.047777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083eebf-55bf-4c3f-ad78-1291e6c0d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.068878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 781/1579] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.070056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.075741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e083eebf-55bf-4c3f-ad78-1291e6c0d3cc None None] MFA Rules not processed for user `3f3adca148414dc9a28f20e37dbe6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:17.076933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e083eebf-55bf-4c3f-ad78-1291e6c0d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:17.081268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563abe6a-ff33-498d-bc6b-b3c98e7c783c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.139048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.139655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.139937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.140202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.140824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.142762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.144768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 799/1580] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:17.148444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083eebf-55bf-4c3f-ad78-1291e6c0d3cc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.158247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083eebf-55bf-4c3f-ad78-1291e6c0d3cc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.159174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.163664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.164247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.164516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.164819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.165445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.169070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 782/1581] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.169221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.169328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.178575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8436ff-e2f3-41cf-ba5c-11174ee63924 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.181958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 800/1582] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.181958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.183735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.184328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.184608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.184883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.185502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.187438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.189248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a8392-93b0-418b-83f8-a59300f87fec admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.194335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.195176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.195176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.195419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.196025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.197961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.209393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.212278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 783/1583] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.213206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.222076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 801/1584] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.222912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.223555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ed697-6e04-42cd-9eca-296f9570b582 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.228689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.229272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.229571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.229844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.230474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.232085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.234035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dad56-d809-468f-b84f-f372ecf74070 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.238906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.240000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.240278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.240548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.241152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.242820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 784/1585] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.243609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.246037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.252776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef950-303d-4ba6-afad-298764f0ce1b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.257928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.258476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.258783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.259110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.259767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.261618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.269430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 802/1586] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.273236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 785/1587] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.273236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.275178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.283486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2ba9f-efbe-44a2-85c7-9739aa27ecd2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.283951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb91c9-fde9-4336-b73a-74d01b08c843 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.288559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.288707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.289139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.289277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.289417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.289598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.289712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.289870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.290326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.290501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.292197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.292443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.303284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 786/1588] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.304047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.313933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdb7f4-922a-4172-a51b-879e592175a2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.319323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.319909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.320186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.320456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.321082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.322389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 803/1589] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.322704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.323557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.336852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 787/1590] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.336852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.344832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd682c-11bc-49a6-bf3b-0df20e32cdf5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.386904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac25ed-6da3-43ba-9503-f1e25a6b874e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.391483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.392076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.392373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.392638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.393260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.394889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.404456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 804/1591] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.405210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.405346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.406012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.406249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.406532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.407470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.409010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.414682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63572fdc-0e4c-43c3-9cfe-5d9469b85cfb admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.421665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 788/1592] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.421831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.421949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.422032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.422032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.422032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] PATH_INFO: `/v3/projects/9d971e2e0cf24b5aa851e3e398a21df4/users/84b2d70a23184c79883b0547d296afc3/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.429633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60367-53ab-4a47-9537-2f13d6af48ff admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.434274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.434845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.435120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.435375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d971e2e0cf24b5aa851e3e398a21df4, user_id=84b2d70a23184c79883b0547d296afc3, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.435499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.435986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.437549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.438007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.448641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 789/1593] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.449531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.454211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 805/1594] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:17 2022] PUT /identity/v3/projects/9d971e2e0cf24b5aa851e3e398a21df4/users/84b2d70a23184c79883b0547d296afc3/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:17.457821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.463730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df924-0e88-4461-bc87-5f5955bc08fe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.520276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.520899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.521173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.521356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c99cb-6284-4d09-a5ad-5c73da0c6538 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.521475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.522166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.523732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.526042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.526635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.526911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.527182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.527818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.529377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.533471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 790/1595] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.534350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.545211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 806/1596] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.545211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.545858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f5b2-41cb-41f3-9098-992a01611fe2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.550397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.550974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.551251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.551505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.552744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.553756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f364-7f67-4b12-94f4-5ae91139fbdc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.554642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.558331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.558955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.559234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.559506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] PATH_INFO: `/v3/projects/8d53885bab4c4f099cbfe74ec5013164/users/3258d70a09ab4cf396123caa11a85ff3/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.571694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.575186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d53885bab4c4f099cbfe74ec5013164, user_id=3258d70a09ab4cf396123caa11a85ff3, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.577172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 791/1597] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:17.577869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.578094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.589578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d305b-bd68-45bc-88f4-b6d8373a791c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.590659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.597146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 807/1598] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:17 2022] PUT /identity/v3/projects/8d53885bab4c4f099cbfe74ec5013164/users/3258d70a09ab4cf396123caa11a85ff3/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:17.603142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.651381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.651986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.652267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.652537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.653171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.654795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.668492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 792/1599] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.668492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.668770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7310f3-1b0e-4958-a6c6-2b0c3fa2a5a8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.672544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca23e5-9d84-47b8-ae3e-4d34cf2cbb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.673175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca23e5-9d84-47b8-ae3e-4d34cf2cbb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.673618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca23e5-9d84-47b8-ae3e-4d34cf2cbb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.673892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca23e5-9d84-47b8-ae3e-4d34cf2cbb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.674519 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca23e5-9d84-47b8-ae3e-4d34cf2cbb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.676076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa18737-7c74-475a-a013-aabbcebf7a1e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.676263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca23e5-9d84-47b8-ae3e-4d34cf2cbb5c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.681465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.682136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.682414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.682688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.683345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.684897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.687374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 808/1600] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.688742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0377-edac-4fe2-a43e-e3b97d73ba43 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.689026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0377-edac-4fe2-a43e-e3b97d73ba43 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.689299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f0377-edac-4fe2-a43e-e3b97d73ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.699256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 793/1601] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.700128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.708628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6b6f0377-edac-4fe2-a43e-e3b97d73ba43 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:17.709853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6b6f0377-edac-4fe2-a43e-e3b97d73ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:17.710209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6c054-c4c0-413f-803b-3197eedd3b4c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.714731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.715360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.715634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.715913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] PATH_INFO: `/v3/projects/e532205a456e49caa940dfb3dc3efe80/users/6d217e30149d4b51817d3770c80f81b4/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.717299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 809/1602] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:17.718082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f0377-edac-4fe2-a43e-e3b97d73ba43 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.728731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f0377-edac-4fe2-a43e-e3b97d73ba43 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.731945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e532205a456e49caa940dfb3dc3efe80, user_id=6d217e30149d4b51817d3770c80f81b4, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.732979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:16:17.732979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:16:17.732979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:16:17.733342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553c00c-2f9f-462a-9298-b10404fc0aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.734098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c00c-2f9f-462a-9298-b10404fc0aad admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.734373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c00c-2f9f-462a-9298-b10404fc0aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.734643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c00c-2f9f-462a-9298-b10404fc0aad admin admin] PATH_INFO: `/v3/projects/6a56bcd05fb340218585909e3dde874e/users/afdb36a7cf1743bb92e0fdf5e3970b3c/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.734931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.749274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 794/1603] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:17 2022] PUT /identity/v3/projects/e532205a456e49caa940dfb3dc3efe80/users/6d217e30149d4b51817d3770c80f81b4/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:17.750049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.753452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553c00c-2f9f-462a-9298-b10404fc0aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a56bcd05fb340218585909e3dde874e, user_id=afdb36a7cf1743bb92e0fdf5e3970b3c, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.756209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553c00c-2f9f-462a-9298-b10404fc0aad admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.769098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 810/1604] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:17 2022] PUT /identity/v3/projects/6a56bcd05fb340218585909e3dde874e/users/afdb36a7cf1743bb92e0fdf5e3970b3c/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:17.770326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd2aa-5002-4ac1-a50d-c1ded58cfb4b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.770610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd2aa-5002-4ac1-a50d-c1ded58cfb4b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.770909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd2aa-5002-4ac1-a50d-c1ded58cfb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.798270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-eebfd2aa-5002-4ac1-a50d-c1ded58cfb4b None None] MFA Rules not processed for user `3258d70a09ab4cf396123caa11a85ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:17.799485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eebfd2aa-5002-4ac1-a50d-c1ded58cfb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:17.818254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc21483-3a28-4062-8764-def820a5d35d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.864043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 811/1605] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:17.865584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd2aa-5002-4ac1-a50d-c1ded58cfb4b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.873437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.874079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.874356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.874623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.875257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.876838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.886710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 795/1606] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:17.887476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.893557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.898085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c145c-4bda-4952-a10d-6dd1df4b16b8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.904118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.904945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.905216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.905476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] PATH_INFO: `/v3/projects/27f14647ea934f2aaf74b0921794bb75/users/8f2506f5520e418aba142ccf67f2bc07/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.922647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f14647ea934f2aaf74b0921794bb75, user_id=8f2506f5520e418aba142ccf67f2bc07, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.925209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.938329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 796/1607] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:17 2022] PUT /identity/v3/projects/27f14647ea934f2aaf74b0921794bb75/users/8f2506f5520e418aba142ccf67f2bc07/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:17.938516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:17.939283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.948875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd2aa-5002-4ac1-a50d-c1ded58cfb4b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.003037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1779-8be0-4dee-9b7e-56a04d5dd054 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.008331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.008990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.009269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.009572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] PATH_INFO: `/v3/projects/7a3a54a26d8c402a97d258a49ebf9274/users/9126f92a547843a99862ae046c8d303a/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.011052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49d1f3-4148-4dcc-89a4-b19052ef35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.011703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49d1f3-4148-4dcc-89a4-b19052ef35e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.011979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49d1f3-4148-4dcc-89a4-b19052ef35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.012245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49d1f3-4148-4dcc-89a4-b19052ef35e4 admin admin] PATH_INFO: `/v3/projects/db504d6155234c1784092a0d9eef8588/users/7abce65bb4814569abad75c0c352f10e/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.024427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3a54a26d8c402a97d258a49ebf9274, user_id=9126f92a547843a99862ae046c8d303a, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.027101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.027860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49d1f3-4148-4dcc-89a4-b19052ef35e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db504d6155234c1784092a0d9eef8588, user_id=7abce65bb4814569abad75c0c352f10e, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.030591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49d1f3-4148-4dcc-89a4-b19052ef35e4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.040606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 797/1608] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:17 2022] PUT /identity/v3/projects/7a3a54a26d8c402a97d258a49ebf9274/users/9126f92a547843a99862ae046c8d303a/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:18.045324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.045443 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 812/1609] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:17 2022] PUT /identity/v3/projects/db504d6155234c1784092a0d9eef8588/users/7abce65bb4814569abad75c0c352f10e/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:18.046240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa3e97-8714-421d-bd1b-0c3236125cd9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.046517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa3e97-8714-421d-bd1b-0c3236125cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.046782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa3e97-8714-421d-bd1b-0c3236125cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.069721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f6fa3e97-8714-421d-bd1b-0c3236125cd9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.070921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f6fa3e97-8714-421d-bd1b-0c3236125cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.106744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d928-ce8e-4212-b5a0-cb106e9a09d6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.133494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 813/1610] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.136166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53dc31-3139-47fd-ada3-988ce5b92f2e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.136684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53dc31-3139-47fd-ada3-988ce5b92f2e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.137170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53dc31-3139-47fd-ada3-988ce5b92f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.157364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7e53dc31-3139-47fd-ada3-988ce5b92f2e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.158620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7e53dc31-3139-47fd-ada3-988ce5b92f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.162147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85239c-73bc-41a6-a829-a6e835e8bb6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.163053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85239c-73bc-41a6-a829-a6e835e8bb6c service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.163579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85239c-73bc-41a6-a829-a6e835e8bb6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.163986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85239c-73bc-41a6-a829-a6e835e8bb6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.167416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 814/1611] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.168210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53dc31-3139-47fd-ada3-988ce5b92f2e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.174280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85239c-73bc-41a6-a829-a6e835e8bb6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.175673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85239c-73bc-41a6-a829-a6e835e8bb6c service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.178584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53dc31-3139-47fd-ada3-988ce5b92f2e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.183189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c680-d01a-443e-830b-5bb4c8cc4800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.183770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c680-d01a-443e-830b-5bb4c8cc4800 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.184046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c680-d01a-443e-830b-5bb4c8cc4800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.184319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c680-d01a-443e-830b-5bb4c8cc4800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.184951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c680-d01a-443e-830b-5bb4c8cc4800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.186256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 798/1612] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:18.186681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c680-d01a-443e-830b-5bb4c8cc4800 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.187374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fc97e-355b-4c4d-9cde-ec6d7118514b None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.187651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fc97e-355b-4c4d-9cde-ec6d7118514b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.188190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fc97e-355b-4c4d-9cde-ec6d7118514b None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.189988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 799/1613] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 30 04:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:18.190868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4bfdb-2318-449e-a339-f8ca804256d2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.191268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4bfdb-2318-449e-a339-f8ca804256d2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.191541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4bfdb-2318-449e-a339-f8ca804256d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.201175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 815/1614] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:18.201175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41512-3f8c-498f-a260-7e3c60b48b7e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.201175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41512-3f8c-498f-a260-7e3c60b48b7e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.201175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b41512-3f8c-498f-a260-7e3c60b48b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.215013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c4b4bfdb-2318-449e-a339-f8ca804256d2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.216232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c4b4bfdb-2318-449e-a339-f8ca804256d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.218725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-38b41512-3f8c-498f-a260-7e3c60b48b7e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.219881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-38b41512-3f8c-498f-a260-7e3c60b48b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.225740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 800/1615] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.227387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071e35-9bcc-4416-b371-9c533006f1fb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.227675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071e35-9bcc-4416-b371-9c533006f1fb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.227948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071e35-9bcc-4416-b371-9c533006f1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.231571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 816/1616] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.231571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b41512-3f8c-498f-a260-7e3c60b48b7e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.241339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b41512-3f8c-498f-a260-7e3c60b48b7e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.245041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.246090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.246574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.247044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.257373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.258816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.261625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7f071e35-9bcc-4416-b371-9c533006f1fb None None] MFA Rules not processed for user `7abce65bb4814569abad75c0c352f10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.262772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7f071e35-9bcc-4416-b371-9c533006f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.267471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.269109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 817/1617] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:18.269862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.281689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccdc31-a847-42f1-8862-f35a111d640f service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.285941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c49e4-b7e3-45f5-99d1-5abd46aaaef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.286907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c49e4-b7e3-45f5-99d1-5abd46aaaef5 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.287187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c49e4-b7e3-45f5-99d1-5abd46aaaef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.287451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c49e4-b7e3-45f5-99d1-5abd46aaaef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.298772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c49e4-b7e3-45f5-99d1-5abd46aaaef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.300234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c49e4-b7e3-45f5-99d1-5abd46aaaef5 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.312681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 818/1618] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:18.313393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8fab0-ff46-4460-9476-6c6934d86c23 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.314310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8fab0-ff46-4460-9476-6c6934d86c23 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.314583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8fab0-ff46-4460-9476-6c6934d86c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.359652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 801/1619] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.359652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071e35-9bcc-4416-b371-9c533006f1fb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.364275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6ed8fab0-ff46-4460-9476-6c6934d86c23 None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.366343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6ed8fab0-ff46-4460-9476-6c6934d86c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.381018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071e35-9bcc-4416-b371-9c533006f1fb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.389827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.390514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.390880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.391170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] PATH_INFO: `/v3/projects/024abf8dede84b628c9645b4781ece23/users/74529a59d7d14d29a50fc306014012ee/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.393648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.421146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024abf8dede84b628c9645b4781ece23, user_id=74529a59d7d14d29a50fc306014012ee, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.423575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.444376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 802/1620] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:18 2022] PUT /identity/v3/projects/024abf8dede84b628c9645b4781ece23/users/74529a59d7d14d29a50fc306014012ee/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:18.445569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.481161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 819/1621] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.482254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8fab0-ff46-4460-9476-6c6934d86c23 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.493305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8fab0-ff46-4460-9476-6c6934d86c23 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.525294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493923a7-0152-43b0-a1ab-2632ce170805 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.529207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d84be-ec6a-4e2d-8549-e001977b0963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.529920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d84be-ec6a-4e2d-8549-e001977b0963 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.530197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d84be-ec6a-4e2d-8549-e001977b0963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.530502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d84be-ec6a-4e2d-8549-e001977b0963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.554902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.555542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.555876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.556156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.618917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d84be-ec6a-4e2d-8549-e001977b0963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.620381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d84be-ec6a-4e2d-8549-e001977b0963 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.633108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 803/1622] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:18.634497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295563-28aa-4e68-bdf7-b0fe64a72db3 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.634895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295563-28aa-4e68-bdf7-b0fe64a72db3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.635175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295563-28aa-4e68-bdf7-b0fe64a72db3 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.636670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 804/1623] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 30 04:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:18.637774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b821a-509e-4d97-a456-559c9a1557e2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.638275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b821a-509e-4d97-a456-559c9a1557e2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.638469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b821a-509e-4d97-a456-559c9a1557e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.650739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.652650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.672775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 820/1624] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:18.673744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b92b821a-509e-4d97-a456-559c9a1557e2 None None] MFA Rules not processed for user `74529a59d7d14d29a50fc306014012ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.673913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.675369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b92b821a-509e-4d97-a456-559c9a1557e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.712015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.774388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.783267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 805/1625] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.784971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe172-faf8-4d69-849e-f5b9aa085f9a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.785255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe172-faf8-4d69-849e-f5b9aa085f9a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.785888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe172-faf8-4d69-849e-f5b9aa085f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.790006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ba559-103c-4d38-a3fa-beebcf532bf4 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.799156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.799878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.800146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.800413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.814606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-584fe172-faf8-4d69-849e-f5b9aa085f9a None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:18.816833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-584fe172-faf8-4d69-849e-f5b9aa085f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.837857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 806/1626] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:18.839660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fe172-faf8-4d69-849e-f5b9aa085f9a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.855844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fe172-faf8-4d69-849e-f5b9aa085f9a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.863110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.864267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.865032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.865547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.866466 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.869623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.907998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 807/1627] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:18.909721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.916240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.918628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.934157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 821/1628] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:18.935084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.947818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1b022-bbf9-4bed-9ce7-d2ea3cbd45ce service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.042299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.042910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.043185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.043630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.044281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.047584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.087156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 822/1629] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:18 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:19.088243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.103805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b0006-c2ff-42ec-9c20-b993dfbb3df1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.107585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba243b-675a-4762-b59f-f17906a76fab admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.121411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.122803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.123109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.123348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.124014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.125894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.132659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7eed-7fe8-44c9-86b9-39e4fa8fc92c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.134217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7eed-7fe8-44c9-86b9-39e4fa8fc92c service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.135331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7eed-7fe8-44c9-86b9-39e4fa8fc92c service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.137339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7eed-7fe8-44c9-86b9-39e4fa8fc92c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.144110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 823/1630] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:19.146601 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.159002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ebb72-c6ba-48a9-bfe6-86aa54303e12 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.164590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.165380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.165698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.165947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] PATH_INFO: `/v3/projects/1c6ff17a52634876be37408a99b9bf0d/users/2d7312c238ae45158bcbabce90cc3a0c/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.191580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6ff17a52634876be37408a99b9bf0d, user_id=2d7312c238ae45158bcbabce90cc3a0c, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.195655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.222610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 824/1631] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:19 2022] PUT /identity/v3/projects/1c6ff17a52634876be37408a99b9bf0d/users/2d7312c238ae45158bcbabce90cc3a0c/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:19.223593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.308322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.315836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bf64-459b-4826-a1c9-40f43d0583d7 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.324925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7eed-7fe8-44c9-86b9-39e4fa8fc92c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.326241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.326241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.326577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.326855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.327600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.329448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.335003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7eed-7fe8-44c9-86b9-39e4fa8fc92c service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.348008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 825/1632] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:19.353004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.357878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 808/1633] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:19.370234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a483f-e6bd-4ed7-b3d3-9f2a9ae5129e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.377845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.378657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.379005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.379283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] PATH_INFO: `/v3/projects/1c6ff17a52634876be37408a99b9bf0d/users/2d7312c238ae45158bcbabce90cc3a0c/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.382075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6ff17a52634876be37408a99b9bf0d, user_id=2d7312c238ae45158bcbabce90cc3a0c, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.384970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.411183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 826/1634] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:19 2022] PUT /identity/v3/projects/1c6ff17a52634876be37408a99b9bf0d/users/2d7312c238ae45158bcbabce90cc3a0c/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:19.412691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378e825-c4a7-4a7e-ab89-4db5a5113e8b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.413274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378e825-c4a7-4a7e-ab89-4db5a5113e8b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.413538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378e825-c4a7-4a7e-ab89-4db5a5113e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.472136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a378e825-c4a7-4a7e-ab89-4db5a5113e8b None None] MFA Rules not processed for user `2d7312c238ae45158bcbabce90cc3a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:19.474270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a378e825-c4a7-4a7e-ab89-4db5a5113e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.499276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.587240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 809/1635] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:19.594517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.658835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fdb6c-99f1-4f4f-a6f2-7957b83d1376 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.659202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fdb6c-99f1-4f4f-a6f2-7957b83d1376 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.659438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fdb6c-99f1-4f4f-a6f2-7957b83d1376 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.660979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 810/1636] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 30 04:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:19.671039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489c1a-287d-4404-9006-66d8c176c29d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.671337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489c1a-287d-4404-9006-66d8c176c29d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.671595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489c1a-287d-4404-9006-66d8c176c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.697691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-65489c1a-287d-4404-9006-66d8c176c29d None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:19.699313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6f109-74dc-45cf-8c92-1f67797eb46a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.699679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-65489c1a-287d-4404-9006-66d8c176c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.703861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9daa49-4ba7-48ae-9e3e-ff5c4fb3d8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.704701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9daa49-4ba7-48ae-9e3e-ff5c4fb3d8bd service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.705095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9daa49-4ba7-48ae-9e3e-ff5c4fb3d8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.705455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9daa49-4ba7-48ae-9e3e-ff5c4fb3d8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.717121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9daa49-4ba7-48ae-9e3e-ff5c4fb3d8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.718651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9daa49-4ba7-48ae-9e3e-ff5c4fb3d8bd service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.731839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 827/1637] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:19.733404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdd908-ccab-4b3b-81a2-962b20470331 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.733712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdd908-ccab-4b3b-81a2-962b20470331 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.734175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdd908-ccab-4b3b-81a2-962b20470331 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.740883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 828/1638] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 30 04:16:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:19.742208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b8c2-2812-4824-9b6d-3e8603424b4c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.742488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b8c2-2812-4824-9b6d-3e8603424b4c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.742760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b8c2-2812-4824-9b6d-3e8603424b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.780932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5413b8c2-2812-4824-9b6d-3e8603424b4c None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:19.782959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5413b8c2-2812-4824-9b6d-3e8603424b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.849943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 811/1639] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:16:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:19.851676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489c1a-287d-4404-9006-66d8c176c29d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.877687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 829/1640] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:16:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:19.878316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489c1a-287d-4404-9006-66d8c176c29d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.879373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b8c2-2812-4824-9b6d-3e8603424b4c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.885750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.887354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.887723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.888291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.890458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b8c2-2812-4824-9b6d-3e8603424b4c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.894832 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.896538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.896813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.897089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.908829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.910282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.923052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 830/1641] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:19.958019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.961112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.970964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 812/1642] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:20.008890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.038445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccdbd5-5145-45ae-9454-09fa9dafbed6 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.049856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e0c57-36f4-4bc4-8b3e-0d9040610d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.050884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0c57-36f4-4bc4-8b3e-0d9040610d75 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.051322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0c57-36f4-4bc4-8b3e-0d9040610d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.051928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e0c57-36f4-4bc4-8b3e-0d9040610d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.071503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0c57-36f4-4bc4-8b3e-0d9040610d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.073545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e0c57-36f4-4bc4-8b3e-0d9040610d75 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.093798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 831/1643] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:20.751525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.835546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:20.858302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ceabfa-63ce-4424-bf79-ef6e5a7cc960 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.864065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.865537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.865892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.866524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] PATH_INFO: `/v3/users/3258d70a09ab4cf396123caa11a85ff3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.867750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3258d70a09ab4cf396123caa11a85ff3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.869013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: WARNING py.warnings [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:16:20.869013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: warnings.warn(msg) Aug 30 04:16:20.869013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: Aug 30 04:16:20.870532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.971599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3258d70a09ab4cf396123caa11a85ff3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.972470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3258d70a09ab4cf396123caa11a85ff3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.986705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3258d70a09ab4cf396123caa11a85ff3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.996641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3258d70a09ab4cf396123caa11a85ff3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.997382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-de45e8f8-1f62-4823-a921-1baf5fc67613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3258d70a09ab4cf396123caa11a85ff3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.054654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 813/1644] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:20 2022] DELETE /identity/v3/users/3258d70a09ab4cf396123caa11a85ff3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:21.056500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.056986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.056986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.062830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.063119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.063395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.111789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:21.111789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.147558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] MFA Rules not processed for user `8f2506f5520e418aba142ccf67f2bc07`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:21.151600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.232337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 814/1645] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:21.244404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:21.289286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 832/1646] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:21.292366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.294157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.307033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.310815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.349533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36901d-f7b8-436e-a446-e14a281a032c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.358671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.359443 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.359789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.360190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.361474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.366211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.423038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba31d6-cc1d-4020-9c93-7beff1b4d2c0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.428348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 833/1647] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:21.430979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.462944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:21.516511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.517770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.518433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.519019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.570440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a4602-d7eb-4900-a0df-9479a37ee949 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.594178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.594925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.595345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.595674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.596545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.599792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.637094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 834/1648] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/users => generated 309 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:21.640960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.658874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f86352-f688-4fd4-a7df-d27d64746a93 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.683937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.685026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.687544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.688853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.689137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.690269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.691624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.696793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.719163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 815/1649] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:21.722163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 835/1650] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:21.727777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.752679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd7f9d-ba9a-47b2-9e5e-51bbf729c2b4 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.766827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.767599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.768553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.768841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] PATH_INFO: `/v3/projects/796670d912a04d039a95dbbeb5f64c97/users/c451136a9b214759a1e142f5419e064b/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.808887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=796670d912a04d039a95dbbeb5f64c97, user_id=c451136a9b214759a1e142f5419e064b, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.813096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.857154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 816/1651] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:21 2022] PUT /identity/v3/projects/796670d912a04d039a95dbbeb5f64c97/users/c451136a9b214759a1e142f5419e064b/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:21.861255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.886054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c09c1-7e1c-4a32-a5d0-83e7a5d7bc2b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.023894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.024725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.025976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.026259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.026959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.028876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.045267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 836/1652] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:16:22.047105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.066165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944909cd-a3d4-4d51-be06-bd81c2d6b2ba admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.082880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.085858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.089046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.089536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] PATH_INFO: `/v3/projects/796670d912a04d039a95dbbeb5f64c97/users/c451136a9b214759a1e142f5419e064b/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.094981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=796670d912a04d039a95dbbeb5f64c97, user_id=c451136a9b214759a1e142f5419e064b, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.097846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.125272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 817/1653] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:22 2022] PUT /identity/v3/projects/796670d912a04d039a95dbbeb5f64c97/users/c451136a9b214759a1e142f5419e064b/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:23.819921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:23.821897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:23.844141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece822a3-02e1-4f44-925c-33c81bee91e2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:23.915949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:24.002050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:24.002967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.003299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.003572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] PATH_INFO: `/v3/projects/8d53885bab4c4f099cbfe74ec5013164` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.006352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d53885bab4c4f099cbfe74ec5013164)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:24.007364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: WARNING py.warnings [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:16:24.007364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: warnings.warn(msg) Aug 30 04:16:24.007364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: Aug 30 04:16:24.011516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:24.171157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:24.174940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.212604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a50501-33bc-438f-8534-c56baddafb6c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:24.220520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d53885bab4c4f099cbfe74ec5013164', 'request_id': 'req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.238184 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d53885bab4c4f099cbfe74ec5013164', 'request_id': 'req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.260703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d53885bab4c4f099cbfe74ec5013164', 'request_id': 'req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.304256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] The token cache is being invalidate because project 8d53885bab4c4f099cbfe74ec5013164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:24.304451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.307319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9a6f0458-31ae-4ae6-8cfa-40f4b3cdb2a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.314287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 837/1654] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:23 2022] DELETE /identity/v3/projects/8d53885bab4c4f099cbfe74ec5013164 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:24.316277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93b53-ae73-4543-baf6-13e776b5dd3d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.316584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93b53-ae73-4543-baf6-13e776b5dd3d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.316845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93b53-ae73-4543-baf6-13e776b5dd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.383085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-40f93b53-ae73-4543-baf6-13e776b5dd3d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:24.384512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-40f93b53-ae73-4543-baf6-13e776b5dd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.444433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:24.445571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.448706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.449226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] PATH_INFO: `/v3/users/3f3adca148414dc9a28f20e37dbe6fba` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.450871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3adca148414dc9a28f20e37dbe6fba)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:24.454647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:24.605168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:24.644267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3adca148414dc9a28f20e37dbe6fba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.665376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3adca148414dc9a28f20e37dbe6fba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.670371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 838/1655] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:24.671913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea046d-6d9f-45b0-9ec1-747ecd21a5d7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.672234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea046d-6d9f-45b0-9ec1-747ecd21a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.672415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea046d-6d9f-45b0-9ec1-747ecd21a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.689209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3adca148414dc9a28f20e37dbe6fba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.709475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3adca148414dc9a28f20e37dbe6fba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.710421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-051a70f2-32de-483f-b4cf-2ba05146b2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3adca148414dc9a28f20e37dbe6fba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.714006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bbea046d-6d9f-45b0-9ec1-747ecd21a5d7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:24.716655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bbea046d-6d9f-45b0-9ec1-747ecd21a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.729229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 839/1656] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:24.735748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea046d-6d9f-45b0-9ec1-747ecd21a5d7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:24.757577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 818/1657] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:24 2022] DELETE /identity/v3/users/3f3adca148414dc9a28f20e37dbe6fba => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:24.771286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea046d-6d9f-45b0-9ec1-747ecd21a5d7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:24.771912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a1358-fdf5-4d05-b485-f5baa6d9f027 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.772310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a1358-fdf5-4d05-b485-f5baa6d9f027 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.772585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a1358-fdf5-4d05-b485-f5baa6d9f027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.815649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-456a1358-fdf5-4d05-b485-f5baa6d9f027 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:24.818676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-456a1358-fdf5-4d05-b485-f5baa6d9f027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.906775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:24.970664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac251-fa48-491b-aacc-778134eaa2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:24.971742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac251-fa48-491b-aacc-778134eaa2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.972166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac251-fa48-491b-aacc-778134eaa2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.972441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac251-fa48-491b-aacc-778134eaa2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.973775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac251-fa48-491b-aacc-778134eaa2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:24.974413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac251-fa48-491b-aacc-778134eaa2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:24.976447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac251-fa48-491b-aacc-778134eaa2c9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.019762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 840/1658] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:25.019762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173dd7-4309-4fe1-9d00-6ba82985bb40 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.030921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173dd7-4309-4fe1-9d00-6ba82985bb40 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.031299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27173dd7-4309-4fe1-9d00-6ba82985bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.065473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 819/1659] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:25.066476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a1358-fdf5-4d05-b485-f5baa6d9f027 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.115102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a1358-fdf5-4d05-b485-f5baa6d9f027 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.140226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.140860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.141227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.141538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.142189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.144111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.152126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-27173dd7-4309-4fe1-9d00-6ba82985bb40 None None] MFA Rules not processed for user `c451136a9b214759a1e142f5419e064b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:25.153339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-27173dd7-4309-4fe1-9d00-6ba82985bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:25.271705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 820/1660] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:25 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:25.272701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.276307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:25.423004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b6bd-970d-4650-a064-1e6f737e740b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.427570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 841/1661] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:25.430088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27173dd7-4309-4fe1-9d00-6ba82985bb40 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.433207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.434128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.434600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.437285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.452978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27173dd7-4309-4fe1-9d00-6ba82985bb40 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.593257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:25.596837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.597806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.601273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.605720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.607691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.614116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.648343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.653186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.665089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 842/1662] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:25 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:25.672376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.696563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e930e3e-c3ef-478a-863a-930f605308fc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.705666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 821/1663] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:25.713239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.714144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.714581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.715008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.715970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.717863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.733701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 843/1664] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:25.735090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.746880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1582a7a-b057-430e-a4cd-d7a1f07dc038 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.752463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247e7b-b72b-4eaa-b59a-b7a3aaeefa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.753189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247e7b-b72b-4eaa-b59a-b7a3aaeefa30 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.753553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247e7b-b72b-4eaa-b59a-b7a3aaeefa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.753898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247e7b-b72b-4eaa-b59a-b7a3aaeefa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.754619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247e7b-b72b-4eaa-b59a-b7a3aaeefa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.757126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32247e7b-b72b-4eaa-b59a-b7a3aaeefa30 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.787894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 822/1665] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:25.789312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.802439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ce19c-c2e2-472a-987c-930a344e355a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.821946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.822971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.823387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.823727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] PATH_INFO: `/v3/projects/434c2ff0beea4e31b17f23f85e34f8cd/users/0e253a569a3941c1a2c4dce936cb9fae/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.852821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=434c2ff0beea4e31b17f23f85e34f8cd, user_id=0e253a569a3941c1a2c4dce936cb9fae, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.857362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.888722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 844/1666] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:25 2022] PUT /identity/v3/projects/434c2ff0beea4e31b17f23f85e34f8cd/users/0e253a569a3941c1a2c4dce936cb9fae/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:25.891013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5c42-76d1-46cf-811c-f9d5392b7647 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.891998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5c42-76d1-46cf-811c-f9d5392b7647 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.892285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5c42-76d1-46cf-811c-f9d5392b7647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.964771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6d8c5c42-76d1-46cf-811c-f9d5392b7647 None None] MFA Rules not processed for user `0e253a569a3941c1a2c4dce936cb9fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:25.969015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6d8c5c42-76d1-46cf-811c-f9d5392b7647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:26.094921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 823/1667] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:26.096227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.137347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:26.176466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ba4b6-8091-4bb5-aa85-eb89105eeb6d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.183399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.184172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.184520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.184853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.185652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.187715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.253170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 845/1668] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:26.254283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c5c42-76d1-46cf-811c-f9d5392b7647 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.272381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c5c42-76d1-46cf-811c-f9d5392b7647 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.433112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.434164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.434164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.434349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.435488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.437035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.486831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 824/1669] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:26.490601 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.503856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5bfe6-b5cf-4a74-980a-e2d87d2b27a3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.516444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.517129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.517415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.517790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.518444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.523665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.551019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 846/1670] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:26.555354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.573479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17985b-5cce-4b5f-a0e8-894d30f8a268 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.582333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.583343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.584164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.584426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] PATH_INFO: `/v3/projects/7956f2efb3044deb97dc99472f54823d/users/b905446685de42d881c37e56f0611ce7/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.622515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7956f2efb3044deb97dc99472f54823d, user_id=b905446685de42d881c37e56f0611ce7, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.625255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.647394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 825/1671] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:26 2022] PUT /identity/v3/projects/7956f2efb3044deb97dc99472f54823d/users/b905446685de42d881c37e56f0611ce7/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:26.649055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.677063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6110d-699f-4f3e-9c4a-ad4a4127625c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.937250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.947913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.948736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.949790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.952607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.954892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.038535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 847/1672] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:27.042656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.060117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde1ea3-7606-480a-9e0a-719748815285 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.077377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8378e54-0dd7-40c9-91c5-ffd9aaa03bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.079203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378e54-0dd7-40c9-91c5-ffd9aaa03bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.079518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378e54-0dd7-40c9-91c5-ffd9aaa03bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.079797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378e54-0dd7-40c9-91c5-ffd9aaa03bf5 admin admin] PATH_INFO: `/v3/projects/7956f2efb3044deb97dc99472f54823d/users/b905446685de42d881c37e56f0611ce7/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.085980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.087392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.096228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8378e54-0dd7-40c9-91c5-ffd9aaa03bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7956f2efb3044deb97dc99472f54823d, user_id=b905446685de42d881c37e56f0611ce7, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.099647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8378e54-0dd7-40c9-91c5-ffd9aaa03bf5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.120675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6e0bb-adc6-4d3c-8247-e7d9a676786b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.138657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.139319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.139585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.139859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] PATH_INFO: `/v3/users/7abce65bb4814569abad75c0c352f10e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.142304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abce65bb4814569abad75c0c352f10e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.144240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.152721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 826/1673] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:27 2022] PUT /identity/v3/projects/7956f2efb3044deb97dc99472f54823d/users/b905446685de42d881c37e56f0611ce7/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:27.163668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d415-cd03-4d07-81d1-2f707a757a46 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.163977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d415-cd03-4d07-81d1-2f707a757a46 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.164219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2d415-cd03-4d07-81d1-2f707a757a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.241834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:27.263091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-06a2d415-cd03-4d07-81d1-2f707a757a46 None None] MFA Rules not processed for user `b905446685de42d881c37e56f0611ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:27.267963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-06a2d415-cd03-4d07-81d1-2f707a757a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.321571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abce65bb4814569abad75c0c352f10e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:27.326590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abce65bb4814569abad75c0c352f10e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:27.359465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abce65bb4814569abad75c0c352f10e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:27.377337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abce65bb4814569abad75c0c352f10e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:27.379724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd4dc6a7-4f7a-49d2-a26d-1b810d1ec87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abce65bb4814569abad75c0c352f10e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:27.407285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 848/1674] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:27 2022] DELETE /identity/v3/users/7abce65bb4814569abad75c0c352f10e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:27.412114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1fa7-1ad0-4be0-a1b9-bb2c89515542 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.412752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1fa7-1ad0-4be0-a1b9-bb2c89515542 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.413236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1fa7-1ad0-4be0-a1b9-bb2c89515542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.451073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-75ea1fa7-1ad0-4be0-a1b9-bb2c89515542 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:27.452416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-75ea1fa7-1ad0-4be0-a1b9-bb2c89515542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.459530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:27.498478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 827/1675] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:27.499950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afd432-3dae-4365-9eef-435831cdc724 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.500243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afd432-3dae-4365-9eef-435831cdc724 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.500874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afd432-3dae-4365-9eef-435831cdc724 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.502985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 828/1676] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:27.510374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afd432-3dae-4365-9eef-435831cdc724 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.512341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-66afd432-3dae-4365-9eef-435831cdc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.566320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 849/1677] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:27.568554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.568820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.569214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.604941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:27.606606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.651031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afd432-3dae-4365-9eef-435831cdc724 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.658438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.659266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.659696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.660105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.828679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 850/1678] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:27.831421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.836958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.874050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.875511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.905424 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 829/1679] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:27.906334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.912084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.947413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010f17-6e23-4a35-a56b-220ad0304987 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.964221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.965231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.965534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.966876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.999144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.001475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16fa50-809b-4e35-bc5e-33472edf55af None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.004157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.016159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.016790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.020866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.022293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.047770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 830/1680] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:28.051120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.054263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.087975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 851/1681] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:28.135237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.153003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20ccaa-2236-4ab4-88d9-65434f6aeb81 service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.164667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.165749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.166032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.166302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.172466 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:28.246983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:28.321921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.323406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.342570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 831/1682] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:28.916081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.917582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:28.938060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c247-7e0d-45e8-a993-f471643d6990 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.957019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.957702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.958873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.959149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] PATH_INFO: `/v3/projects/115fc067003a4b87ba0148d9f21a394b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.964631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=115fc067003a4b87ba0148d9f21a394b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.966596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:29.106295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:29.116681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115fc067003a4b87ba0148d9f21a394b', 'request_id': 'req-8c2edacd-5155-4877-bd17-682d9844d84c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.128045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115fc067003a4b87ba0148d9f21a394b', 'request_id': 'req-8c2edacd-5155-4877-bd17-682d9844d84c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.152278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115fc067003a4b87ba0148d9f21a394b', 'request_id': 'req-8c2edacd-5155-4877-bd17-682d9844d84c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.169767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] The token cache is being invalidate because project 115fc067003a4b87ba0148d9f21a394b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:29.170063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.172809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.175336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 852/1683] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:28 2022] DELETE /identity/v3/projects/115fc067003a4b87ba0148d9f21a394b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:29.180419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:29.197319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed539-91fe-43c6-bef7-4aac1165c0bf service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:29.371925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:29.371925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:29.371925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:29.371925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] PATH_INFO: `/v3/users/74529a59d7d14d29a50fc306014012ee` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:29.373211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74529a59d7d14d29a50fc306014012ee)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:29.375323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:29.551296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74529a59d7d14d29a50fc306014012ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.554702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74529a59d7d14d29a50fc306014012ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.577455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74529a59d7d14d29a50fc306014012ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.602005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74529a59d7d14d29a50fc306014012ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.603353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d6be4a0-eb67-4fd4-a39a-7d6536c842d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74529a59d7d14d29a50fc306014012ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:29.682573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 832/1684] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:29 2022] DELETE /identity/v3/users/74529a59d7d14d29a50fc306014012ee => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:30.370691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:30.373430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:30.398132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2edacd-5155-4877-bd17-682d9844d84c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:30.545045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:30.546424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:30.546720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:30.547076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] PATH_INFO: `/v3/projects/db504d6155234c1784092a0d9eef8588` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:30.548821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=db504d6155234c1784092a0d9eef8588)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:30.562823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:30.672206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db504d6155234c1784092a0d9eef8588', 'request_id': 'req-2c2f1cb0-5212-49e7-bc45-984e6da30fef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.690313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db504d6155234c1784092a0d9eef8588', 'request_id': 'req-2c2f1cb0-5212-49e7-bc45-984e6da30fef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.708500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db504d6155234c1784092a0d9eef8588', 'request_id': 'req-2c2f1cb0-5212-49e7-bc45-984e6da30fef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.730132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] The token cache is being invalidate because project db504d6155234c1784092a0d9eef8588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:30.730644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.733849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.735898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 853/1685] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:30 2022] DELETE /identity/v3/projects/db504d6155234c1784092a0d9eef8588 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:30.743610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575feba2-f616-453b-babf-c7374c22d81c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:30.744115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575feba2-f616-453b-babf-c7374c22d81c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:30.744224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575feba2-f616-453b-babf-c7374c22d81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:30.764484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:30.765989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:30.812840 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-575feba2-f616-453b-babf-c7374c22d81c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:30.814112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-575feba2-f616-453b-babf-c7374c22d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:30.944825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:30.979092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1cb0-5212-49e7-bc45-984e6da30fef admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:30.994921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 833/1686] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:30.996696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3f4d-f8ab-4a59-8ac0-f877cb61e552 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:30.997184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3f4d-f8ab-4a59-8ac0-f877cb61e552 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:30.997694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3f4d-f8ab-4a59-8ac0-f877cb61e552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.015337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.016326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.017437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.017437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] PATH_INFO: `/v3/projects/024abf8dede84b628c9645b4781ece23` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.018964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] RBAC: Authorizing `identity:delete_project(project_id=024abf8dede84b628c9645b4781ece23)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.021735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.024544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:31.033982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c1bc3f4d-f8ab-4a59-8ac0-f877cb61e552 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:31.042614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c1bc3f4d-f8ab-4a59-8ac0-f877cb61e552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:31.061798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 834/1687] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:31.065819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc3f4d-f8ab-4a59-8ac0-f877cb61e552 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.087229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc3f4d-f8ab-4a59-8ac0-f877cb61e552 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.108888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.110034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.110542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.111017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.111877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:31.112374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.115038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.145105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 835/1688] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:31.149329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.153482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024abf8dede84b628c9645b4781ece23', 'request_id': 'req-2e2a71af-9b4f-481a-ad90-55fbe60f846d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.167107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024abf8dede84b628c9645b4781ece23', 'request_id': 'req-2e2a71af-9b4f-481a-ad90-55fbe60f846d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.170306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919faee-bc17-4830-9221-cf87e3efcf82 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.202043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024abf8dede84b628c9645b4781ece23', 'request_id': 'req-2e2a71af-9b4f-481a-ad90-55fbe60f846d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.225706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] The token cache is being invalidate because project 024abf8dede84b628c9645b4781ece23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:31.226139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.228986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.233576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 854/1689] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:30 2022] DELETE /identity/v3/projects/024abf8dede84b628c9645b4781ece23 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:31.235148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.236541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:31.303724 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.304462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.304850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.305186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.305930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.307907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.360813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 836/1690] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:31 2022] POST /identity/v3/projects => generated 369 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:31.365475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.367339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:31.399764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a71af-9b4f-481a-ad90-55fbe60f846d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.504298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb4506-083e-4bde-90fa-5805716866d7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.515777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.516755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.516755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.517017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.517856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.519829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.552439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.552746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.553006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.553336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] PATH_INFO: `/v3/users/2d7312c238ae45158bcbabce90cc3a0c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.555926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7312c238ae45158bcbabce90cc3a0c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.568618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 837/1691] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:31 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:31.571481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.572621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.587013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc660ecf-3c2f-41e1-a38a-57109481c98a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.592708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.599398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.599679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.599954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.600616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.608118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.631363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 838/1692] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:16:31.635584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.653753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243605d-a213-4bd6-8c0e-f05c24721b46 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.662542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.663219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.663498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.664232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.667117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.670310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.677972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:31.686884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7312c238ae45158bcbabce90cc3a0c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.687634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7312c238ae45158bcbabce90cc3a0c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.692492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 839/1693] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:31.696926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.701702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:31.718309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7312c238ae45158bcbabce90cc3a0c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.732030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e57b5a-5812-4184-a4f8-c8de5c091acb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.735371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7312c238ae45158bcbabce90cc3a0c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.736372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d2737aa1-fe1c-46cb-affe-4055dc447b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7312c238ae45158bcbabce90cc3a0c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:31.752661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.754540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.755831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.757303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] PATH_INFO: `/v3/projects/0d59a5a850fc4bcb9998dd14312e50eb/users/bf97af5753d74dc1b525fbe176b79f0a/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.762738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 855/1694] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:31 2022] DELETE /identity/v3/users/2d7312c238ae45158bcbabce90cc3a0c => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:31.786499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d59a5a850fc4bcb9998dd14312e50eb, user_id=bf97af5753d74dc1b525fbe176b79f0a, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.791917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.819802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:31.825971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 840/1695] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:31 2022] PUT /identity/v3/projects/0d59a5a850fc4bcb9998dd14312e50eb/users/bf97af5753d74dc1b525fbe176b79f0a/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:31.838899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.839217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.839635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.882112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] MFA Rules not processed for user `bf97af5753d74dc1b525fbe176b79f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:31.883581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:32.068552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 856/1696] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:32.072784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.232601 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.234345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:32.242952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5059f6-2c5c-4144-9a5a-b135394f76cd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.253766 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.254394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.254698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.255516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.256170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.258119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.278857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5896fcf-2193-4787-bc20-8a46f23aa90b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.291836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.293958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.294221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.296315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] PATH_INFO: `/v3/users/0e253a569a3941c1a2c4dce936cb9fae` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.298204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e253a569a3941c1a2c4dce936cb9fae)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.300258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.327861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 841/1697] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:32 2022] POST /identity/v3/projects => generated 369 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:32.331907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.422052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e253a569a3941c1a2c4dce936cb9fae'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:32.424914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e253a569a3941c1a2c4dce936cb9fae'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:32.447582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e253a569a3941c1a2c4dce936cb9fae'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:32.457094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e253a569a3941c1a2c4dce936cb9fae'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:32.458709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7c288bd3-9166-41a1-8526-961b17651837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e253a569a3941c1a2c4dce936cb9fae'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:32.483074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 857/1698] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:32 2022] DELETE /identity/v3/users/0e253a569a3941c1a2c4dce936cb9fae => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:32.484788 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ade5-d2b9-41a6-84d3-27737d8c05f6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.485790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.486234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.486911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.512331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:32.514711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:32.533150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:32.604495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 858/1699] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:32.626800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.628483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:32.640350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.642007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.642801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.643032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.644879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.654291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.724385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 842/1700] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:32 2022] POST /identity/v3/users => generated 291 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:32.731318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.733416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:32.764008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12fcaf-b304-43b3-a688-3820700843fd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.775884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.776982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.777463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.779055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.779987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.782075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.798868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 843/1701] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:16:32.800121 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:32.802264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:32.802516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ade9fe-3954-4c0e-be3f-0e623a31d60c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.813544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dc1a0-d30f-4034-a6bf-bc18dc0f02cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.814903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc1a0-d30f-4034-a6bf-bc18dc0f02cf service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.824976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc1a0-d30f-4034-a6bf-bc18dc0f02cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.825925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc1a0-d30f-4034-a6bf-bc18dc0f02cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.830907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b3ef-f526-4f9b-a6ae-0384db7e6c8b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:32.844035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:32.844718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.845055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.845577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] PATH_INFO: `/v3/projects/1c6ff17a52634876be37408a99b9bf0d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:32.848082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6ff17a52634876be37408a99b9bf0d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.855154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.856321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc1a0-d30f-4034-a6bf-bc18dc0f02cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:32.858141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc1a0-d30f-4034-a6bf-bc18dc0f02cf service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:32.873359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:32.889009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 859/1702] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:32.895127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:32.895778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:32.896257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.024255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6ff17a52634876be37408a99b9bf0d', 'request_id': 'req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.027669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] MFA Rules not processed for user `afdb36a7cf1743bb92e0fdf5e3970b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:33.032888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.054551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6ff17a52634876be37408a99b9bf0d', 'request_id': 'req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.064012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6ff17a52634876be37408a99b9bf0d', 'request_id': 'req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.111128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] The token cache is being invalidate because project 1c6ff17a52634876be37408a99b9bf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:33.111435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.115392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-17fa1ceb-5dd5-476e-ac14-434c9ad277ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.124336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 844/1703] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:32 2022] DELETE /identity/v3/projects/1c6ff17a52634876be37408a99b9bf0d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:33.130741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7c00-7b3e-4194-957b-97e0231a967e None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.134596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7c00-7b3e-4194-957b-97e0231a967e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.135164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7c00-7b3e-4194-957b-97e0231a967e None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.136761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 845/1704] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:16:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:33.137338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7c00-7b3e-4194-957b-97e0231a967e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:33.147765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a20f7c00-7b3e-4194-957b-97e0231a967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.249995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 860/1705] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:33.251513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:33.259622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.339411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7c00-7b3e-4194-957b-97e0231a967e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:33.357108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab2a87-057a-4ad6-8b65-82e2e9d5dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:33.358032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab2a87-057a-4ad6-8b65-82e2e9d5dcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.358917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab2a87-057a-4ad6-8b65-82e2e9d5dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.359193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab2a87-057a-4ad6-8b65-82e2e9d5dcc9 admin admin] PATH_INFO: `/v3/projects/0cf47c64009a4e7abaa0843dda230788/users/ad1729f837df4c0bb9ef45050fbf971e/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.378445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:33.405730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b38cb5-005f-4648-93a3-4d45b7a217ed None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:33.418162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:33.420852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab2a87-057a-4ad6-8b65-82e2e9d5dcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf47c64009a4e7abaa0843dda230788, user_id=ad1729f837df4c0bb9ef45050fbf971e, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:33.421863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.422173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.422747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] PATH_INFO: `/v3/users/8f2506f5520e418aba142ccf67f2bc07` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.424265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2506f5520e418aba142ccf67f2bc07)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:33.425826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab2a87-057a-4ad6-8b65-82e2e9d5dcc9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:33.429726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:33.471375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 846/1706] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:33 2022] PUT /identity/v3/projects/0cf47c64009a4e7abaa0843dda230788/users/ad1729f837df4c0bb9ef45050fbf971e/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:33.472692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcf02e-605d-48fe-9f1f-601778fe63c2 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.472978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcf02e-605d-48fe-9f1f-601778fe63c2 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.473305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcf02e-605d-48fe-9f1f-601778fe63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.525810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-acdcf02e-605d-48fe-9f1f-601778fe63c2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:33.529333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-acdcf02e-605d-48fe-9f1f-601778fe63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.544973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2506f5520e418aba142ccf67f2bc07'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.545968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2506f5520e418aba142ccf67f2bc07'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.575604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2506f5520e418aba142ccf67f2bc07'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.601541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2506f5520e418aba142ccf67f2bc07'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.602318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-85872965-637a-4cca-9b6d-85f1dad016f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2506f5520e418aba142ccf67f2bc07'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.629331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 861/1707] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:33 2022] DELETE /identity/v3/users/8f2506f5520e418aba142ccf67f2bc07 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:33.630725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.631006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.631415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.685849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:33.687426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.691078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 847/1708] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:33.693447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc775-f4be-4bf5-b89d-f480937d2644 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.693749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc775-f4be-4bf5-b89d-f480937d2644 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.694024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc775-f4be-4bf5-b89d-f480937d2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.750728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-df6cc775-f4be-4bf5-b89d-f480937d2644 None None] MFA Rules not processed for user `afdb36a7cf1743bb92e0fdf5e3970b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:33.751972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-df6cc775-f4be-4bf5-b89d-f480937d2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.798968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:33.850196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 862/1709] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:33.851114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:33.852527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.958628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 848/1710] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:33.958628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.958628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.958628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.016702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0ab71-1e2b-4a46-83b8-fd0cd2bf2d58 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:34.018786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:34.025122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:34.037903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:34.038866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.039359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.039802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.040636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:34.044819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:34.054213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 849/1711] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:34.054213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.057631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:34.079899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 863/1712] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:34.080894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.105606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:34.112520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdd4c1-0080-4e4c-b7cc-011869701b2a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:34.131211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:34.131843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.132120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.132433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.133084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:34.133382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:34.135118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:34.172289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 864/1713] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:34.172289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.172556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:34.205580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cf150-1ff2-4b49-848a-f294855e489c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:34.227069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:34.227849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.228129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.228623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.251438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:34.255566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:34.285772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 865/1714] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:34.288237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.312435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cd585-bb48-45c7-bc82-b45d84d373cf service placement] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:34.319951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932b82f-6009-4784-b97d-874f22d247a6 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:34.328614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:34.329365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.329922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.330088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] PATH_INFO: `/v3/projects/0cf47c64009a4e7abaa0843dda230788/users/ad1729f837df4c0bb9ef45050fbf971e/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.331687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:34.335047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf47c64009a4e7abaa0843dda230788, user_id=ad1729f837df4c0bb9ef45050fbf971e, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:34.335766 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.336616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.336616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.341656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:34.346328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:34.366903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 866/1715] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:34 2022] PUT /identity/v3/projects/0cf47c64009a4e7abaa0843dda230788/users/ad1729f837df4c0bb9ef45050fbf971e/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:34.367852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.380581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:34.382540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:34.396391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 850/1716] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:34.428972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.433165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:34.455877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d661b4-16dd-4e2c-9c77-22d20d116e60 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:34.560476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56238d-7254-470e-93e7-f32ce304f90a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:34.580916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc571b1-6b0d-47fb-af2d-33f38a2a3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:34.580916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc571b1-6b0d-47fb-af2d-33f38a2a3c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.580916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc571b1-6b0d-47fb-af2d-33f38a2a3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.580916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc571b1-6b0d-47fb-af2d-33f38a2a3c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.581405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc571b1-6b0d-47fb-af2d-33f38a2a3c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:34.582131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc571b1-6b0d-47fb-af2d-33f38a2a3c5c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:34.612368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:34.616830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.618816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.621222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] PATH_INFO: `/v3/projects/434c2ff0beea4e31b17f23f85e34f8cd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.624634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] RBAC: Authorizing `identity:delete_project(project_id=434c2ff0beea4e31b17f23f85e34f8cd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:34.635418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:34.675904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 867/1717] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:34 2022] POST /identity/v3/projects => generated 365 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:34.681145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:34.681436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:34.682431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:34.755269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] MFA Rules not processed for user `ad1729f837df4c0bb9ef45050fbf971e`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:34.756860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:34.759108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:34.766306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434c2ff0beea4e31b17f23f85e34f8cd', 'request_id': 'req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:34.786504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434c2ff0beea4e31b17f23f85e34f8cd', 'request_id': 'req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:34.795411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434c2ff0beea4e31b17f23f85e34f8cd', 'request_id': 'req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:34.830444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] The token cache is being invalidate because project 434c2ff0beea4e31b17f23f85e34f8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:34.830999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:34.834272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:34.842589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 851/1718] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:34 2022] DELETE /identity/v3/projects/434c2ff0beea4e31b17f23f85e34f8cd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:34.842589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.844553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:34.907125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 868/1719] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:34.908181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.909537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.016876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:35.018994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3ce65-1fd4-4c45-97c0-bbcbe629801a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:35.038839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:35.040719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.041981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.043704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.044580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:35.050929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:35.085700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520237a2-4d3d-4d78-88e7-e8455af6ab75 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:35.105471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 852/1720] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:34 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:35.106576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:35.113090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.127652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:35.127652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.127652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.127652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] PATH_INFO: `/v3/users/b905446685de42d881c37e56f0611ce7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.137153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b905446685de42d881c37e56f0611ce7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:35.142929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:35.251147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b905446685de42d881c37e56f0611ce7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:35.251991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b905446685de42d881c37e56f0611ce7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:35.279139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b905446685de42d881c37e56f0611ce7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:35.292593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f323f-2791-4447-88e5-513b2bf088c2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:35.295867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b905446685de42d881c37e56f0611ce7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:35.296542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b905446685de42d881c37e56f0611ce7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:35.306150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:35.306870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.307296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.307632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.311176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.328191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 869/1721] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:34 2022] DELETE /identity/v3/users/b905446685de42d881c37e56f0611ce7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:35.329145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:35.333797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.357209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:35.358809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:35.390804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 853/1722] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:35.536942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db51211-6954-4ea5-ae3e-cf8dbb62d9ff admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:35.549468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:35.550301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.550762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.551035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.551845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:35.553447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:35.579583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 870/1723] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:35.584214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:35.603708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5d5d2-b1d0-4d0f-a612-5960a789e65c service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:35.616513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc9b6-0eee-4a3d-800d-58e4ccf4a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:35.617137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc9b6-0eee-4a3d-800d-58e4ccf4a6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.617412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc9b6-0eee-4a3d-800d-58e4ccf4a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.618192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc9b6-0eee-4a3d-800d-58e4ccf4a6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.618908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc9b6-0eee-4a3d-800d-58e4ccf4a6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:35.621720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc9b6-0eee-4a3d-800d-58e4ccf4a6f8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:35.646503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:35.659467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 854/1724] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:35.666338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41c223-37c8-44d4-a778-a2231a8669cd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:35.683615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:35.684274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.684462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.684745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] PATH_INFO: `/v3/projects/bd35f5a2eeb941c59442ca6466aabce3/users/f84f21305e784d2488601dc643c83c81/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.721176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd35f5a2eeb941c59442ca6466aabce3, user_id=f84f21305e784d2488601dc643c83c81, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:35.728935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:35.770293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 871/1725] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:35 2022] PUT /identity/v3/projects/bd35f5a2eeb941c59442ca6466aabce3/users/f84f21305e784d2488601dc643c83c81/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:35.783103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472e9c4-e266-44c9-8b2d-8651e90dc5c8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.783383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472e9c4-e266-44c9-8b2d-8651e90dc5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.783661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472e9c4-e266-44c9-8b2d-8651e90dc5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.850420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9472e9c4-e266-44c9-8b2d-8651e90dc5c8 None None] MFA Rules not processed for user `f84f21305e784d2488601dc643c83c81`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:35.851780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9472e9c4-e266-44c9-8b2d-8651e90dc5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.033733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:36.108816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 855/1726] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:36.110332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.186939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:36.253499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba399fd-f28d-4ed3-9291-c87616567a8f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.276766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.278105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.278398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.279284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.280392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.282901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.322524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac610-0b3f-480f-81b9-b20771006263 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.322801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac610-0b3f-480f-81b9-b20771006263 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.323120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ac610-0b3f-480f-81b9-b20771006263 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.324609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 856/1727] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 30 04:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:16:36.334673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.335107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.335379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.347304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 872/1728] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:36 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:36.348917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.431193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] MFA Rules not processed for user `f520107f73aa48f791461922a3d6ec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:36.433339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.511596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226086ab-0e06-4929-9441-2c71d3a2b742 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.531612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.532352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.532773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.533668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.534058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.536956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.600364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 857/1729] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:16:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:36.601773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.605672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.607752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 873/1730] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:36 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:36.608821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.638232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393707a-04fe-4018-a35b-96ec023fa8b7 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.638331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3e86-70f8-4eec-964b-e68251b7889a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.644481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.646308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.646694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.648113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.648933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.649315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.649720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.650487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.650625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] PATH_INFO: `/v3/projects/27f14647ea934f2aaf74b0921794bb75` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.652271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.656484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f14647ea934f2aaf74b0921794bb75)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.662550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.685647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 874/1731] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:36.690267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.696762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.726013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c385f7-e28f-40b0-97b8-a9b59d5974d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.736308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.737121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.737552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.738035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.753547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.757262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.781577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 875/1732] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:36.782656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.805348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f14647ea934f2aaf74b0921794bb75', 'request_id': 'req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.812865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ec7b3-4369-4267-a2c8-019be3a8808f service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.856752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f14647ea934f2aaf74b0921794bb75', 'request_id': 'req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.888603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f14647ea934f2aaf74b0921794bb75', 'request_id': 'req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.931126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] The token cache is being invalidate because project 27f14647ea934f2aaf74b0921794bb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:36.931126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.931974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.934185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 858/1733] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:36 2022] DELETE /identity/v3/projects/27f14647ea934f2aaf74b0921794bb75 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:36.938450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.944452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.955546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.956916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.957363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.958394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] PATH_INFO: `/v3/projects/e56887aaad0d4ca1a132a273aa33e103/users/dd62172643c0474097b127fdff333b3b/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.983960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56887aaad0d4ca1a132a273aa33e103, user_id=dd62172643c0474097b127fdff333b3b, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.987715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.989204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0da3-1bb3-45f3-9edf-a5266c5f9d1e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.999885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.000813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.001207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.001673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] PATH_INFO: `/v3/users/c451136a9b214759a1e142f5419e064b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.005230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c451136a9b214759a1e142f5419e064b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.007514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.014539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:37.026905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 876/1734] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:36 2022] PUT /identity/v3/projects/e56887aaad0d4ca1a132a273aa33e103/users/dd62172643c0474097b127fdff333b3b/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:37.031291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.033398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:37.139863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c451136a9b214759a1e142f5419e064b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:37.141234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c451136a9b214759a1e142f5419e064b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:37.150635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c451136a9b214759a1e142f5419e064b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:37.152873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:37.170542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c451136a9b214759a1e142f5419e064b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:37.171586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c451136a9b214759a1e142f5419e064b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:37.204792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 859/1735] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:36 2022] DELETE /identity/v3/users/c451136a9b214759a1e142f5419e064b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:37.216527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eded5-bb74-4a4a-a14b-f4d4ecb2f975 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.414495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ba1fd-6e8c-490a-b1d2-ee628331dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.415200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ba1fd-6e8c-490a-b1d2-ee628331dfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.415432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ba1fd-6e8c-490a-b1d2-ee628331dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.415710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ba1fd-6e8c-490a-b1d2-ee628331dfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.416425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ba1fd-6e8c-490a-b1d2-ee628331dfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.427247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ba1fd-6e8c-490a-b1d2-ee628331dfa6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.476327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 877/1736] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:37.478922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.487100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:37.517984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0a724-2314-4793-b31b-97a5f3a2ad37 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.533744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.537163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.537540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.538532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] PATH_INFO: `/v3/projects/e56887aaad0d4ca1a132a273aa33e103/users/dd62172643c0474097b127fdff333b3b/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.545078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56887aaad0d4ca1a132a273aa33e103, user_id=dd62172643c0474097b127fdff333b3b, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.553208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.637032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 860/1737] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:37 2022] PUT /identity/v3/projects/e56887aaad0d4ca1a132a273aa33e103/users/dd62172643c0474097b127fdff333b3b/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:37.650026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.652109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.652456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.665581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.672072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:37.695074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] MFA Rules not processed for user `dd62172643c0474097b127fdff333b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:37.696771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:37.927130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c0f35-3844-454f-89f7-22327c49a741 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.938781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.939443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.939722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.939997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] PATH_INFO: `/v3/projects/7956f2efb3044deb97dc99472f54823d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.946992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7956f2efb3044deb97dc99472f54823d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.951178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.964261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 878/1738] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:37.977871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.979521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.057141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:38.087889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7956f2efb3044deb97dc99472f54823d', 'request_id': 'req-a7dd6d71-21c8-4883-af17-c4b4027921f7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.112159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7956f2efb3044deb97dc99472f54823d', 'request_id': 'req-a7dd6d71-21c8-4883-af17-c4b4027921f7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.128492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7956f2efb3044deb97dc99472f54823d', 'request_id': 'req-a7dd6d71-21c8-4883-af17-c4b4027921f7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.146287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6e610-c20c-4759-b236-a8f52423acbe None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.168437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] The token cache is being invalidate because project 7956f2efb3044deb97dc99472f54823d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:38.168732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.170529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.176380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 861/1739] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:37 2022] DELETE /identity/v3/projects/7956f2efb3044deb97dc99472f54823d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:38.178023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.182298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.314273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450896c-e520-40c4-a92a-28e7b013fe54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.322672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450896c-e520-40c4-a92a-28e7b013fe54 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.323157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450896c-e520-40c4-a92a-28e7b013fe54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.324647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450896c-e520-40c4-a92a-28e7b013fe54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.328074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5450896c-e520-40c4-a92a-28e7b013fe54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.427624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:38.459191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd6d71-21c8-4883-af17-c4b4027921f7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.485987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.488704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.488704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.488704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] PATH_INFO: `/v3/projects/796670d912a04d039a95dbbeb5f64c97` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.490950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796670d912a04d039a95dbbeb5f64c97)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.495046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.528350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450896c-e520-40c4-a92a-28e7b013fe54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.531544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450896c-e520-40c4-a92a-28e7b013fe54 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.556521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 879/1740] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:38.559215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f257de-44f9-406b-9182-8fbabb01a80e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.559504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f257de-44f9-406b-9182-8fbabb01a80e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.560174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f257de-44f9-406b-9182-8fbabb01a80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.605937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a2f257de-44f9-406b-9182-8fbabb01a80e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:38.610513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a2f257de-44f9-406b-9182-8fbabb01a80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.647499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796670d912a04d039a95dbbeb5f64c97', 'request_id': 'req-72b372e7-e71f-43ec-8a05-5390e146b2c9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.679686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796670d912a04d039a95dbbeb5f64c97', 'request_id': 'req-72b372e7-e71f-43ec-8a05-5390e146b2c9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.695986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796670d912a04d039a95dbbeb5f64c97', 'request_id': 'req-72b372e7-e71f-43ec-8a05-5390e146b2c9'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.721593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] The token cache is being invalidate because project 796670d912a04d039a95dbbeb5f64c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:38.721921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.723283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:38.730169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 862/1741] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:38 2022] DELETE /identity/v3/projects/796670d912a04d039a95dbbeb5f64c97 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:38.735087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.738596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.795299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 880/1742] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:38.796799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0ef0-0649-4d85-b361-a782c58f55d5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.797090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0ef0-0649-4d85-b361-a782c58f55d5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.797359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0ef0-0649-4d85-b361-a782c58f55d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.850227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-75fc0ef0-0649-4d85-b361-a782c58f55d5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:38.853974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-75fc0ef0-0649-4d85-b361-a782c58f55d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.880479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 881/1743] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:38.882450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e052a7-2f02-49d8-baae-9bcc659eb399 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.882941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e052a7-2f02-49d8-baae-9bcc659eb399 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.883347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e052a7-2f02-49d8-baae-9bcc659eb399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.932752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b372e7-e71f-43ec-8a05-5390e146b2c9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.939185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.939840 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.940117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.941075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] PATH_INFO: `/v3/users/bf97af5753d74dc1b525fbe176b79f0a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.943215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf97af5753d74dc1b525fbe176b79f0a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.945587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.947227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-49e052a7-2f02-49d8-baae-9bcc659eb399 None None] MFA Rules not processed for user `84b2d70a23184c79883b0547d296afc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:38.948563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-49e052a7-2f02-49d8-baae-9bcc659eb399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.984889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:39.031168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf97af5753d74dc1b525fbe176b79f0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:39.031698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf97af5753d74dc1b525fbe176b79f0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:39.046008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf97af5753d74dc1b525fbe176b79f0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:39.066751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf97af5753d74dc1b525fbe176b79f0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:39.068268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf97af5753d74dc1b525fbe176b79f0a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:39.093049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:39.103920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 863/1744] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:38 2022] DELETE /identity/v3/users/bf97af5753d74dc1b525fbe176b79f0a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:39.105095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.107011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.151454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 882/1745] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:39.151454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81664-077c-44a1-aabd-a30c3adcb37f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.151454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81664-077c-44a1-aabd-a30c3adcb37f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.151454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81664-077c-44a1-aabd-a30c3adcb37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.189015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a5c81664-077c-44a1-aabd-a30c3adcb37f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:39.191271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a5c81664-077c-44a1-aabd-a30c3adcb37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.226959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a13f41-9941-467e-8318-a39bac5146cb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.237768 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.238626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.239981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.241057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.245561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.339064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 883/1746] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:39.339064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578595cb-429f-4171-a36a-5facb5661efb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.339064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578595cb-429f-4171-a36a-5facb5661efb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.339064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578595cb-429f-4171-a36a-5facb5661efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.365018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.366485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-578595cb-429f-4171-a36a-5facb5661efb None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:39.367725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-578595cb-429f-4171-a36a-5facb5661efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.368280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.376405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 884/1747] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:39.378575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311721-3131-4fd8-a89f-551945039d1d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.379126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311721-3131-4fd8-a89f-551945039d1d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.379816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311721-3131-4fd8-a89f-551945039d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.385199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 864/1748] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:39.386262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.388060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.406969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b6311721-3131-4fd8-a89f-551945039d1d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:39.408280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b6311721-3131-4fd8-a89f-551945039d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.431033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 885/1749] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:39.438236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bdd5e-6298-4bb0-979d-5a9a74e09c1e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.438521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bdd5e-6298-4bb0-979d-5a9a74e09c1e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.439219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bdd5e-6298-4bb0-979d-5a9a74e09c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.492190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f88bdd5e-6298-4bb0-979d-5a9a74e09c1e None None] MFA Rules not processed for user `84b2d70a23184c79883b0547d296afc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:39.493748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f88bdd5e-6298-4bb0-979d-5a9a74e09c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.540982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365cc0-ade5-4049-b566-0c13c6d67ace service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.548032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.549717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.550204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.550540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.553964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.570276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.572795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.631410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 865/1750] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:39.632369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.668959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 886/1751] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:39.669877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bdd5e-6298-4bb0-979d-5a9a74e09c1e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.677756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c96435-076b-4aee-a19d-930b27b908da service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.685836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.700866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.701699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.702045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.707283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:39.708889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.712578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bdd5e-6298-4bb0-979d-5a9a74e09c1e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.717256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.734630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068903eb-b518-415c-b741-c0c49277ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.734899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068903eb-b518-415c-b741-c0c49277ae33 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.735174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068903eb-b518-415c-b741-c0c49277ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.735439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068903eb-b518-415c-b741-c0c49277ae33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.736091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068903eb-b518-415c-b741-c0c49277ae33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:39.736388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068903eb-b518-415c-b741-c0c49277ae33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.741816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 866/1752] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:39.744022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.746425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068903eb-b518-415c-b741-c0c49277ae33 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.747149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.783583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 887/1753] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:39.785174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.788045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.788551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.845431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:39.851410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] MFA Rules not processed for user `9126f92a547843a99862ae046c8d303a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:39.852825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.896195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d7e93-60ed-4aab-b85f-a3bafb7b5b45 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.905466 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169990a-5bce-45ed-b8fd-a4c076d153fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.906402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169990a-5bce-45ed-b8fd-a4c076d153fc service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.906764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169990a-5bce-45ed-b8fd-a4c076d153fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.907169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169990a-5bce-45ed-b8fd-a4c076d153fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.926225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169990a-5bce-45ed-b8fd-a4c076d153fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.928088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169990a-5bce-45ed-b8fd-a4c076d153fc service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.945444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:39.961998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 867/1754] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:39.967128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e51cd-c6be-42d0-8129-adbf4620b300 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.968069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e51cd-c6be-42d0-8129-adbf4620b300 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.969269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e51cd-c6be-42d0-8129-adbf4620b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.073937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 888/1755] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:40.078069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ea6e51cd-c6be-42d0-8129-adbf4620b300 None None] MFA Rules not processed for user `6d217e30149d4b51817d3770c80f81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:40.079437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ea6e51cd-c6be-42d0-8129-adbf4620b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:40.090104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.091494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:40.264527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6622d-a885-4747-beed-d253d9581d8a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.278007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.279729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.280190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.280812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.292936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.296005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.311190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 889/1756] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:40.312218 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.336546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 868/1757] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:40.336546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e51cd-c6be-42d0-8129-adbf4620b300 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.339440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9712d-1e23-46f7-863c-33000f5cacef service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.352216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.353215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.353859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.354330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.356715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.359558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.374470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e51cd-c6be-42d0-8129-adbf4620b300 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.389951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.390837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.391118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.391386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.392027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.398557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.433166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 890/1758] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:40 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:40.437271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.444481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:40.480253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 869/1759] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:40 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:40.481206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.632887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b60a-deec-4735-b011-c40a85a44fce admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.646482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.646798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.647149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.647625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.648344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.651344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdc69-186c-4e6a-ab97-56b8617ed4d4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.653059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.698486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:40.708409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 870/1760] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:40 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:40.709365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.733777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56e429-cad9-4f5d-9c6f-3c677255b4d3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.750478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.751336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.751641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.751909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.752557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.755295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.775472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.776172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.776523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.776864 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.817711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 871/1761] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:40 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:40.819522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.843328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51628685-0d41-4a4d-81ce-51492212fde5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.860472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.861708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.861708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.862866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.865313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.870080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.878865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.881034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.905382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 872/1762] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:40.907505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.909836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 891/1763] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:40.911776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:40.912190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:40.932430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:40.951408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b396-b5ce-4c21-8330-2a1b070e232a service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.955008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6fe16-d805-4d30-810c-d3625377cd6a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:40.961730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.963610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.965014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.966657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.967516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:40.968008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.968294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:40.968566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:40.968832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] PATH_INFO: `/v3/projects/0d59a5a850fc4bcb9998dd14312e50eb` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:40.972273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.974060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d59a5a850fc4bcb9998dd14312e50eb)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:40.978069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:40.992861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 892/1764] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:40.993839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:41.038209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306644c-9d44-4d06-878a-5f5a217bd814 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:41.052830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:41.053228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.056063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.056440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:41.057135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:41.059797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:41.075770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 893/1765] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:41.077629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:41.100178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c91a14-1653-4c25-9f79-f95107ee7abc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:41.116156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d59a5a850fc4bcb9998dd14312e50eb', 'request_id': 'req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.139552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d59a5a850fc4bcb9998dd14312e50eb', 'request_id': 'req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.147053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d59a5a850fc4bcb9998dd14312e50eb', 'request_id': 'req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.184759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] The token cache is being invalidate because project 0d59a5a850fc4bcb9998dd14312e50eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:41.187824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.188055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:41.188685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.189092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.189411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:41.190226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:41.191207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.192615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:41.200571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 873/1766] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:40 2022] DELETE /identity/v3/projects/0d59a5a850fc4bcb9998dd14312e50eb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:41.203227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:41.205118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 894/1767] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:41.206127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:41.209430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:41.210982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:41.232412 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d1b5d-9ab7-4180-9119-d822fa4cbdd3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:41.245054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64b582-5178-43e7-9ab4-2a2f5ea0e1ec admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:41.248091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:41.248828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.249120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.249394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] PATH_INFO: `/v3/users/ad1729f837df4c0bb9ef45050fbf971e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:41.251506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1729f837df4c0bb9ef45050fbf971e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:41.256016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:41.256690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:41.257372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.257676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.257955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] PATH_INFO: `/v3/projects/220450cd909e4f6eba58bfd077f52b56/users/1a25ca8cc7864e06ae87f51a81d827e2/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:41.294271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220450cd909e4f6eba58bfd077f52b56, user_id=1a25ca8cc7864e06ae87f51a81d827e2, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:41.297109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:41.329788 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 874/1768] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:41 2022] PUT /identity/v3/projects/220450cd909e4f6eba58bfd077f52b56/users/1a25ca8cc7864e06ae87f51a81d827e2/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:41.340351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:41.349706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:41.390189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:41.411361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1729f837df4c0bb9ef45050fbf971e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.412111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1729f837df4c0bb9ef45050fbf971e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.431548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1729f837df4c0bb9ef45050fbf971e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.450176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1729f837df4c0bb9ef45050fbf971e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.451683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8bf4f43b-d7f2-47ce-8ea1-34af46cf4e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1729f837df4c0bb9ef45050fbf971e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:41.487275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 895/1769] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:41 2022] DELETE /identity/v3/users/ad1729f837df4c0bb9ef45050fbf971e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:41.504040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f69b6-7a3d-473f-9534-f1f00b915c24 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.506942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f69b6-7a3d-473f-9534-f1f00b915c24 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.507262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f69b6-7a3d-473f-9534-f1f00b915c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:41.532378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25c329-06c6-4782-90aa-b22858da4305 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:41.622025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2d0f69b6-7a3d-473f-9534-f1f00b915c24 None None] MFA Rules not processed for user `1a25ca8cc7864e06ae87f51a81d827e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:41.625844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2d0f69b6-7a3d-473f-9534-f1f00b915c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:41.732495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:41.735664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.735941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.738515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] PATH_INFO: `/v3/projects/b7ddde7d93b54992891ef6714b17aee4/users/ac14b0b1ffc14b37b16ce0d19e98b32d/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:41.768886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:41.781215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ddde7d93b54992891ef6714b17aee4, user_id=ac14b0b1ffc14b37b16ce0d19e98b32d, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:41.790505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:41.831023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 875/1770] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:41 2022] PUT /identity/v3/projects/b7ddde7d93b54992891ef6714b17aee4/users/ac14b0b1ffc14b37b16ce0d19e98b32d/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:41.831893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:41.839407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:41.859938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 896/1771] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:41.861241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.861539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.861820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.012432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] MFA Rules not processed for user `ac14b0b1ffc14b37b16ce0d19e98b32d`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:42.013697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.168215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c1cec-2555-449f-87ee-06ab7a99d6c2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:42.205811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8fd0d-d16f-4b1a-9892-43bc876b91ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:42.206611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8fd0d-d16f-4b1a-9892-43bc876b91ac service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.206960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8fd0d-d16f-4b1a-9892-43bc876b91ac service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.207239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8fd0d-d16f-4b1a-9892-43bc876b91ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.216773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7de8fd0d-d16f-4b1a-9892-43bc876b91ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.320980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 897/1772] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:42.322516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:42.328017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.421473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8fd0d-d16f-4b1a-9892-43bc876b91ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:42.424272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8fd0d-d16f-4b1a-9892-43bc876b91ac service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:42.431161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:42.452664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 876/1773] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:42.454599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb093bb-ebe1-4fb6-a318-1c33c0cb05e1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.454599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb093bb-ebe1-4fb6-a318-1c33c0cb05e1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.454803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb093bb-ebe1-4fb6-a318-1c33c0cb05e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.501490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-afb093bb-ebe1-4fb6-a318-1c33c0cb05e1 None None] MFA Rules not processed for user `84b2d70a23184c79883b0547d296afc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:42.505283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-afb093bb-ebe1-4fb6-a318-1c33c0cb05e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.506798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad9eeb-b2e3-4047-9118-fa124fc83992 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:42.518071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:42.518749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.519190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.519663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.522322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:42.527202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:42.587999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 898/1774] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:42.589665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:42.595437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.641982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 877/1775] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:42.644499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb093bb-ebe1-4fb6-a318-1c33c0cb05e1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:42.669921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb093bb-ebe1-4fb6-a318-1c33c0cb05e1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:42.750218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:42.752090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b0661-9ce3-4feb-9cc5-a78484167766 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:42.768922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:42.769755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.770185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.770558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.771257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:42.778260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:42.835430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:42.837848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.838365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.840177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.841154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:42.843557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:42.871217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 899/1776] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:42 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:42.875366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:42.880997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.924807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 878/1777] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:42 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:42.925729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:42.956388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ab1a9-5a20-452d-b1c9-63ad63bcce21 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.081619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c5594-35d4-46a2-a63f-947f26bb717c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.091534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.092178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.093181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.093458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] PATH_INFO: `/v3/projects/0cf47c64009a4e7abaa0843dda230788` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.095993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf47c64009a4e7abaa0843dda230788)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.099507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:43.116626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.119579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.119864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.120139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.120819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.126397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:43.174948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 879/1778] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:42 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:43.180922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.211994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c70b-0a70-49ab-8861-5a4c13d8aa58 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.213371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:43.221475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf47c64009a4e7abaa0843dda230788', 'request_id': 'req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.236407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf47c64009a4e7abaa0843dda230788', 'request_id': 'req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.257872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf47c64009a4e7abaa0843dda230788', 'request_id': 'req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.284458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] The token cache is being invalidate because project 0cf47c64009a4e7abaa0843dda230788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:43.284757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.288697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.291126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 900/1779] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:42 2022] DELETE /identity/v3/projects/0cf47c64009a4e7abaa0843dda230788 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:43.295759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.300946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.405804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15389240-1967-4e40-be26-8da66dc1e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.406442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389240-1967-4e40-be26-8da66dc1e1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.406775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389240-1967-4e40-be26-8da66dc1e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.407050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389240-1967-4e40-be26-8da66dc1e1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.407703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15389240-1967-4e40-be26-8da66dc1e1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.409317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15389240-1967-4e40-be26-8da66dc1e1ca admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:43.451570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 880/1780] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:43.451570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.451570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.451570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.535852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:43.535852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.555641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434cb9d-3cb1-475b-adf6-b8bb6b41aae6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.567948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 881/1781] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:43.568793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.577787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.583784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b667ee-8400-4f9b-9d4d-d8aa56cdbea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.584422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b667ee-8400-4f9b-9d4d-d8aa56cdbea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.584696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b667ee-8400-4f9b-9d4d-d8aa56cdbea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.584967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b667ee-8400-4f9b-9d4d-d8aa56cdbea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.587978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b667ee-8400-4f9b-9d4d-d8aa56cdbea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.589679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b667ee-8400-4f9b-9d4d-d8aa56cdbea9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:43.610043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c098e1-9c47-4e77-a1be-b4418b525cf1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.620917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317740bd-db00-49b4-98cb-c89e1c99d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.622419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317740bd-db00-49b4-98cb-c89e1c99d24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.622829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317740bd-db00-49b4-98cb-c89e1c99d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.623110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317740bd-db00-49b4-98cb-c89e1c99d24a admin admin] PATH_INFO: `/v3/projects/20cee8a5f10c42e682d1ff7389118102/users/cfbd43fba2184a25930c70d8388c6913/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.642582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 901/1782] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:43.645468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e8f9-5820-4561-8614-343f1c2b76d6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.646379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e8f9-5820-4561-8614-343f1c2b76d6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.647135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56e8f9-5820-4561-8614-343f1c2b76d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.657895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317740bd-db00-49b4-98cb-c89e1c99d24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cee8a5f10c42e682d1ff7389118102, user_id=cfbd43fba2184a25930c70d8388c6913, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.661523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317740bd-db00-49b4-98cb-c89e1c99d24a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:43.687486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 882/1783] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:43 2022] PUT /identity/v3/projects/20cee8a5f10c42e682d1ff7389118102/users/cfbd43fba2184a25930c70d8388c6913/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:43.689395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b39b1-94b9-46e0-90c1-4a84bfde8586 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.689858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b39b1-94b9-46e0-90c1-4a84bfde8586 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.691803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b39b1-94b9-46e0-90c1-4a84bfde8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.709352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bb56e8f9-5820-4561-8614-343f1c2b76d6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:43.713546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bb56e8f9-5820-4561-8614-343f1c2b76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.781275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:43.836970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3b1b39b1-94b9-46e0-90c1-4a84bfde8586 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:43.838704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3b1b39b1-94b9-46e0-90c1-4a84bfde8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.954040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 902/1784] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:43.959169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56e8f9-5820-4561-8614-343f1c2b76d6 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.981139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56e8f9-5820-4561-8614-343f1c2b76d6 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.995908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.996831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.997256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.997646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] PATH_INFO: `/v3/projects/26405503f9be45ef96f86947c64c3f89/users/54fa5cedaf814518a403ec370ac9b168/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.031157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 883/1785] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:16:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:44.032519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b39b1-94b9-46e0-90c1-4a84bfde8586 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.087703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26405503f9be45ef96f86947c64c3f89, user_id=54fa5cedaf814518a403ec370ac9b168, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.095643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.095771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b39b1-94b9-46e0-90c1-4a84bfde8586 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.121087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.121949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.122749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.122749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.123656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.125482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.133676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 903/1786] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:43 2022] PUT /identity/v3/projects/26405503f9be45ef96f86947c64c3f89/users/54fa5cedaf814518a403ec370ac9b168/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:44.134658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.168618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 884/1787] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:44.168618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.198800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f639b-7edd-43dd-add5-421c446eba33 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.262222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:44.297414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8905-0042-40db-9cc5-944bc78e83b1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.303411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.304171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.304547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.305037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.305817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.306875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.307513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.307731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.307850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.308045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.308686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:44.308986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.315586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.325621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 885/1788] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:44.327381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.347286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 904/1789] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:44.348952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.353845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81714-39f8-4763-95f4-ede80d3935ef admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.369923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.371661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.372161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.372621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] PATH_INFO: `/v3/projects/20cee8a5f10c42e682d1ff7389118102/users/cfbd43fba2184a25930c70d8388c6913/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.374862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cee8a5f10c42e682d1ff7389118102, user_id=cfbd43fba2184a25930c70d8388c6913, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.381275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f468-7392-4673-a8b1-44bca37c8b92 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.391907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7fc2-db00-48fb-9b0b-7757cb74d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.392583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7fc2-db00-48fb-9b0b-7757cb74d536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.392857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7fc2-db00-48fb-9b0b-7757cb74d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.393231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7fc2-db00-48fb-9b0b-7757cb74d536 admin admin] PATH_INFO: `/v3/projects/26405503f9be45ef96f86947c64c3f89/users/54fa5cedaf814518a403ec370ac9b168/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.398855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.399035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a7fc2-db00-48fb-9b0b-7757cb74d536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26405503f9be45ef96f86947c64c3f89, user_id=54fa5cedaf814518a403ec370ac9b168, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.406686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a7fc2-db00-48fb-9b0b-7757cb74d536 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.428296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 886/1790] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:44 2022] PUT /identity/v3/projects/20cee8a5f10c42e682d1ff7389118102/users/cfbd43fba2184a25930c70d8388c6913/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:44.429542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.441792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 905/1791] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:44 2022] PUT /identity/v3/projects/26405503f9be45ef96f86947c64c3f89/users/54fa5cedaf814518a403ec370ac9b168/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:44.443910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d4ec-36c7-40d5-a4d2-c1f7796a426a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.444193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d4ec-36c7-40d5-a4d2-c1f7796a426a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.444459 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d4ec-36c7-40d5-a4d2-c1f7796a426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.516914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8963d4ec-36c7-40d5-a4d2-c1f7796a426a None None] MFA Rules not processed for user `cfbd43fba2184a25930c70d8388c6913`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:44.518368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8963d4ec-36c7-40d5-a4d2-c1f7796a426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:44.592186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd4c9-2386-4fec-b724-d21f919d4f25 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.605337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:44.687203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 906/1792] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:44.688813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.689098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.689368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.725724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] MFA Rules not processed for user `54fa5cedaf814518a403ec370ac9b168`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:44.726865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:44.751838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.752731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.753167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.753615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.754566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.756632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.828706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 887/1793] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:44 2022] POST /identity/v3/projects => generated 375 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:44.829983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.842427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:44.876111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 907/1794] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:44.876982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.887000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.016971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:45.073368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46498aa-924b-4b4e-a4bd-f4983595fc22 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.203910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.208116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.209845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.210227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.212709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b2a1b-07d9-4ac8-b05c-c3d45e70f9be admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.225233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.226826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.227363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.227685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.325549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.327565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.352991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 908/1795] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:45.354071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.457121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da75f90-b84f-4c22-b266-c569e1f4a7d7 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.469149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09a47-6e92-4d3e-9371-f8b40a55f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.470275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09a47-6e92-4d3e-9371-f8b40a55f79e admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.470698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09a47-6e92-4d3e-9371-f8b40a55f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.471455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09a47-6e92-4d3e-9371-f8b40a55f79e admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.471876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c09a47-6e92-4d3e-9371-f8b40a55f79e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.474810 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c09a47-6e92-4d3e-9371-f8b40a55f79e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.498754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.501852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.516938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 888/1796] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:45.520005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.523373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.529982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 909/1797] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:45.531188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c514e5-197c-4145-a917-51a61f5dc09c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.531446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c514e5-197c-4145-a917-51a61f5dc09c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.531719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c514e5-197c-4145-a917-51a61f5dc09c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.546137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 910/1798] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 30 04:16:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:45.548392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c514e5-197c-4145-a917-51a61f5dc09c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.556798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e83409-b50a-489c-97cf-1370f0076f9b service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.566423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.567516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.567958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.568845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.574723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.596005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c514e5-197c-4145-a917-51a61f5dc09c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.612851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3f622-77b1-4109-acba-e5a96884086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.613540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f622-77b1-4109-acba-e5a96884086e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.613842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f622-77b1-4109-acba-e5a96884086e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.615792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3f622-77b1-4109-acba-e5a96884086e admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.616460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3f622-77b1-4109-acba-e5a96884086e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.618094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3f622-77b1-4109-acba-e5a96884086e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.618502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:45.662125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 911/1799] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:45.663662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b3eb-e83f-470b-84b2-d3fb8546159e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.663951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b3eb-e83f-470b-84b2-d3fb8546159e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.664228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45b3eb-e83f-470b-84b2-d3fb8546159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.736814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1c45b3eb-e83f-470b-84b2-d3fb8546159e None None] MFA Rules not processed for user `f520107f73aa48f791461922a3d6ec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:45.736814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1c45b3eb-e83f-470b-84b2-d3fb8546159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.762287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.763822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.784454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:45.796168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 889/1800] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:45.797312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.830634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c8617-fdd8-40b7-94d0-f5c022cc1bc6 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.842202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.842978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.843253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.843562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] PATH_INFO: `/v3/users/1a25ca8cc7864e06ae87f51a81d827e2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.844792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a25ca8cc7864e06ae87f51a81d827e2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.847011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.977887 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 912/1801] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:45.979702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b3eb-e83f-470b-84b2-d3fb8546159e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:46.007035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a25ca8cc7864e06ae87f51a81d827e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:46.010041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a25ca8cc7864e06ae87f51a81d827e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:46.016741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45b3eb-e83f-470b-84b2-d3fb8546159e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:46.058013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.058645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.058925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.059202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.059857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:46.068369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a25ca8cc7864e06ae87f51a81d827e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:46.074029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:46.105879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a25ca8cc7864e06ae87f51a81d827e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:46.106735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a25ca8cc7864e06ae87f51a81d827e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:46.113008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 913/1802] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:46.115457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:46.125676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.175110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5679-27c7-4cbf-9ede-403086f31a55 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:46.191172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 890/1803] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:45 2022] DELETE /identity/v3/users/1a25ca8cc7864e06ae87f51a81d827e2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:46.195511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:46.196362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e82a1b-cdc9-40a5-b99e-40f67d1fb500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.197045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82a1b-cdc9-40a5-b99e-40f67d1fb500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.197319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82a1b-cdc9-40a5-b99e-40f67d1fb500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.197624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82a1b-cdc9-40a5-b99e-40f67d1fb500 admin admin] PATH_INFO: `/v3/projects/4c20db5a6f874bc3a283ae4e7351bbd7/users/775c8b550191432dba8f25ad35143e43/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.202977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.283091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82a1b-cdc9-40a5-b99e-40f67d1fb500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c20db5a6f874bc3a283ae4e7351bbd7, user_id=775c8b550191432dba8f25ad35143e43, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:46.286087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82a1b-cdc9-40a5-b99e-40f67d1fb500 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:46.328340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 914/1804] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:46 2022] PUT /identity/v3/projects/4c20db5a6f874bc3a283ae4e7351bbd7/users/775c8b550191432dba8f25ad35143e43/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:46.340187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae0635-bdef-4f4a-a187-b3a4f3b32d9a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.340187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae0635-bdef-4f4a-a187-b3a4f3b32d9a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.340187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae0635-bdef-4f4a-a187-b3a4f3b32d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.438830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8fae0635-bdef-4f4a-a187-b3a4f3b32d9a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:46.445141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8fae0635-bdef-4f4a-a187-b3a4f3b32d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.557730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3ea4-294e-4d3f-8e4d-00bc780e4e32 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:46.619853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:46.635404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5953d-5a49-4173-a77f-c722f6d0d7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.636091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5953d-5a49-4173-a77f-c722f6d0d7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.636411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5953d-5a49-4173-a77f-c722f6d0d7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.636702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5953d-5a49-4173-a77f-c722f6d0d7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.639486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-aee5953d-5a49-4173-a77f-c722f6d0d7e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.668946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5953d-5a49-4173-a77f-c722f6d0d7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:46.670975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5953d-5a49-4173-a77f-c722f6d0d7e8 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:46.682603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 891/1805] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:46.684032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026769d-1f8c-4364-9c16-f954adecd1eb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.684338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026769d-1f8c-4364-9c16-f954adecd1eb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.684720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026769d-1f8c-4364-9c16-f954adecd1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.712621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 915/1806] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:46.713953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.714244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.714514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.782420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] MFA Rules not processed for user `9126f92a547843a99862ae046c8d303a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:46.783824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.814494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2026769d-1f8c-4364-9c16-f954adecd1eb None None] MFA Rules not processed for user `775c8b550191432dba8f25ad35143e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:46.815767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2026769d-1f8c-4364-9c16-f954adecd1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.893295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 916/1807] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:46.896644 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:46.902190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.950774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4dcc0-a9ed-4e7d-ba20-6d046990edba None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:46.971244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.971986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.972263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.972681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.016263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:47.017847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:47.044922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 917/1808] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:47.082276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 892/1809] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:47.087229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:47.099415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced609d5-f345-4d34-b709-acf460112f62 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:47.114498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:47.115106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:47.115382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:47.115662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.116315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:47.118365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:47.203942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 918/1810] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:47 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:47.208829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026769d-1f8c-4364-9c16-f954adecd1eb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:47.226176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026769d-1f8c-4364-9c16-f954adecd1eb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:47.373290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:47.374025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:47.374302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:47.374671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.375442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:47.378270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:47.427693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 893/1811] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:47 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:47.432431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:47.441139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:47.447671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac0bfa-c596-4361-9343-fd126b1f005e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:47.468789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:47.469719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:47.470345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:47.470836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.471710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:47.474032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:47.498565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:47.509266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3622-daa6-4c85-b6cf-5626f83de3c3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:47.509983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 919/1812] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:47.521222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:47.525568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:47.525950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:47.526260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] PATH_INFO: `/v3/projects/f765c8cc27f74caaa49850b27b1aaedc/users/fd29ec1e812a4e3bbbfa5025ed09ab90/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.558981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f765c8cc27f74caaa49850b27b1aaedc, user_id=fd29ec1e812a4e3bbbfa5025ed09ab90, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:47.563093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:47.590737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 894/1813] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:47 2022] PUT /identity/v3/projects/f765c8cc27f74caaa49850b27b1aaedc/users/fd29ec1e812a4e3bbbfa5025ed09ab90/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:47.594995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:47.619412 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb681d63-cc4e-435b-99e7-192f7ae95bf3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:47.814492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39864-aa14-4fb8-aceb-239bcdc9e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:47.815389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39864-aa14-4fb8-aceb-239bcdc9e9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:47.815827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39864-aa14-4fb8-aceb-239bcdc9e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:47.816244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39864-aa14-4fb8-aceb-239bcdc9e9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.817623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df39864-aa14-4fb8-aceb-239bcdc9e9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:47.819460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df39864-aa14-4fb8-aceb-239bcdc9e9d1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:47.838593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 920/1814] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:47.842670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:47.856162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac98dd-adff-41e7-b1b1-fb7f6fd983fa admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:47.862459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:47.864517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:47.865038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:47.865538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] PATH_INFO: `/v3/projects/f765c8cc27f74caaa49850b27b1aaedc/users/fd29ec1e812a4e3bbbfa5025ed09ab90/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.868955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f765c8cc27f74caaa49850b27b1aaedc, user_id=fd29ec1e812a4e3bbbfa5025ed09ab90, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:47.871937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:47.896767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 895/1815] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:47 2022] PUT /identity/v3/projects/f765c8cc27f74caaa49850b27b1aaedc/users/fd29ec1e812a4e3bbbfa5025ed09ab90/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:47.910538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:47.911230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:47.911847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:47.962379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] MFA Rules not processed for user `fd29ec1e812a4e3bbbfa5025ed09ab90`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:47.964062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:47.993418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:47.998335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:48.080872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:48.168861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675ee6-5287-4980-b45f-bec2d2cf8c3d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:48.185202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:48.186042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:48.188478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:48.189343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] PATH_INFO: `/v3/users/f84f21305e784d2488601dc643c83c81` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:48.193375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84f21305e784d2488601dc643c83c81)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:48.195099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 921/1816] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:48.198197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:48.206988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:48.210230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:48.389452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84f21305e784d2488601dc643c83c81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:48.391070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84f21305e784d2488601dc643c83c81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:48.431316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84f21305e784d2488601dc643c83c81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:48.449437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84f21305e784d2488601dc643c83c81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:48.451353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84f21305e784d2488601dc643c83c81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:48.463365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc2fbc-8675-495b-aee5-87564997302a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:48.475238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519b5f6-3858-45e9-81a3-2d000ccb4532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:48.475867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519b5f6-3858-45e9-81a3-2d000ccb4532 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:48.476146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519b5f6-3858-45e9-81a3-2d000ccb4532 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:48.476416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519b5f6-3858-45e9-81a3-2d000ccb4532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:48.486307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6519b5f6-3858-45e9-81a3-2d000ccb4532 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:48.524896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 896/1817] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:47 2022] DELETE /identity/v3/users/f84f21305e784d2488601dc643c83c81 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:48.524896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:48.525937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:48.561661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:48.678219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519b5f6-3858-45e9-81a3-2d000ccb4532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:48.683402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519b5f6-3858-45e9-81a3-2d000ccb4532 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:48.718471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709efc8-2e96-41ca-a20d-59fdbf576b64 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:48.737550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a07f1-b867-4a5e-a239-6a0e99803c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:48.738256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a07f1-b867-4a5e-a239-6a0e99803c56 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:48.739267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a07f1-b867-4a5e-a239-6a0e99803c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:48.739902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a07f1-b867-4a5e-a239-6a0e99803c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:48.741598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 922/1818] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:48.742230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ca7a07f1-b867-4a5e-a239-6a0e99803c56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:48.743103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:48.743388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:48.743664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:48.810758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:48.815368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:48.902074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a07f1-b867-4a5e-a239-6a0e99803c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:48.906635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a07f1-b867-4a5e-a239-6a0e99803c56 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:48.938952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:48.985101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 897/1819] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:48.987388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5619-7e5c-49a5-ade1-e6bf253500c1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:48.993792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5619-7e5c-49a5-ade1-e6bf253500c1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:48.993792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5619-7e5c-49a5-ade1-e6bf253500c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:48.994637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 923/1820] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:49.030467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:49.031964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:49.036107 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a0eb5619-7e5c-49a5-ade1-e6bf253500c1 None None] MFA Rules not processed for user `f520107f73aa48f791461922a3d6ec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:49.037425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a0eb5619-7e5c-49a5-ade1-e6bf253500c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:49.226154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 898/1821] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 30 04:16:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:49.283728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179e189-96bf-4aa1-8017-3976057b4567 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:49.300244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:49.302565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:49.305205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5619-7e5c-49a5-ade1-e6bf253500c1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:49.305836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:49.307624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:49.333774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5619-7e5c-49a5-ade1-e6bf253500c1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:49.346644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:49.348940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:49.349471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:49.355071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:49.357098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:49.357449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:49.391191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:49.398307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:49.408788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 924/1822] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:49.435943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 899/1823] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:50.492304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:50.494628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:50.535294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1256-00b4-4f40-a83c-bbe7405d6591 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:50.568488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:50.569317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:50.569745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:50.570112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] PATH_INFO: `/v3/projects/220450cd909e4f6eba58bfd077f52b56` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:50.590624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=220450cd909e4f6eba58bfd077f52b56)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:50.593175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:50.767110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220450cd909e4f6eba58bfd077f52b56', 'request_id': 'req-0df07e67-dd72-4def-bdf2-f03728cc7eda'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:50.780903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220450cd909e4f6eba58bfd077f52b56', 'request_id': 'req-0df07e67-dd72-4def-bdf2-f03728cc7eda'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:50.794198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:50.810427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220450cd909e4f6eba58bfd077f52b56', 'request_id': 'req-0df07e67-dd72-4def-bdf2-f03728cc7eda'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:50.840209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] The token cache is being invalidate because project 220450cd909e4f6eba58bfd077f52b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:50.840905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:50.845805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:50.852173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 925/1824] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:50 2022] DELETE /identity/v3/projects/220450cd909e4f6eba58bfd077f52b56 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:50.855932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:50.883675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c227c0-1826-4b0f-a473-f2c08056bd08 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:51.158001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:51.158729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:51.159251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:51.160008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] PATH_INFO: `/v3/users/cfbd43fba2184a25930c70d8388c6913` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:51.163831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbd43fba2184a25930c70d8388c6913)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:51.168453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:51.451318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbd43fba2184a25930c70d8388c6913'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:51.452242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbd43fba2184a25930c70d8388c6913'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:51.477364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbd43fba2184a25930c70d8388c6913'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:51.498852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbd43fba2184a25930c70d8388c6913'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:51.499806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b6a72c82-df91-47af-955d-a698d644052a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbd43fba2184a25930c70d8388c6913'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:51.537786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 900/1825] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:50 2022] DELETE /identity/v3/users/cfbd43fba2184a25930c70d8388c6913 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:52.655467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:52.656960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:52.902500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df07e67-dd72-4def-bdf2-f03728cc7eda admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:53.198293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:53.198937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:53.199217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:53.199487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:53.204771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:53.457135 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70e386-aa8e-4ff7-978f-59dcc8acf932 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:53.458406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70e386-aa8e-4ff7-978f-59dcc8acf932 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:53.459098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70e386-aa8e-4ff7-978f-59dcc8acf932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:53.491730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:53.494853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:53.542693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2b70e386-aa8e-4ff7-978f-59dcc8acf932 None None] MFA Rules not processed for user `6d217e30149d4b51817d3770c80f81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:53.550740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2b70e386-aa8e-4ff7-978f-59dcc8acf932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:53.552189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 926/1826] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 897 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:53.615448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:53.741451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:53.743786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:53.826923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 901/1827] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:53.861345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:53.867215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd281f-08c8-48e0-86c5-a76febe05d36 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:53.873610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:53.873610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:53.873610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:53.874137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] PATH_INFO: `/v3/projects/bd35f5a2eeb941c59442ca6466aabce3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:53.875022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd35f5a2eeb941c59442ca6466aabce3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:53.877282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:53.998695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd35f5a2eeb941c59442ca6466aabce3', 'request_id': 'req-b20b6bb4-fe56-4e81-9557-d821a1a82918'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.011457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd35f5a2eeb941c59442ca6466aabce3', 'request_id': 'req-b20b6bb4-fe56-4e81-9557-d821a1a82918'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.031359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd35f5a2eeb941c59442ca6466aabce3', 'request_id': 'req-b20b6bb4-fe56-4e81-9557-d821a1a82918'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.053041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] The token cache is being invalidate because project bd35f5a2eeb941c59442ca6466aabce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:54.054449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.055070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.064109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 927/1828] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:53 2022] DELETE /identity/v3/projects/bd35f5a2eeb941c59442ca6466aabce3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:54.065224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70e386-aa8e-4ff7-978f-59dcc8acf932 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:54.086575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70e386-aa8e-4ff7-978f-59dcc8acf932 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:54.180239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:54.182072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:54.322813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:54.323805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:54.324289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:54.324755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] PATH_INFO: `/v3/users/dd62172643c0474097b127fdff333b3b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:54.328870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd62172643c0474097b127fdff333b3b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:54.332717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:54.372655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6bb4-fe56-4e81-9557-d821a1a82918 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:54.385083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:54.385762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:54.386042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:54.386314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] PATH_INFO: `/v3/users/ac14b0b1ffc14b37b16ce0d19e98b32d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:54.389140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac14b0b1ffc14b37b16ce0d19e98b32d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:54.392463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:54.475565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd62172643c0474097b127fdff333b3b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.478255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd62172643c0474097b127fdff333b3b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.515267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd62172643c0474097b127fdff333b3b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.536485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd62172643c0474097b127fdff333b3b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.539538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f0ce09f9-a123-4bf5-8fa2-8a0223ee2993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd62172643c0474097b127fdff333b3b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.544307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac14b0b1ffc14b37b16ce0d19e98b32d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.545197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac14b0b1ffc14b37b16ce0d19e98b32d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.584669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 902/1829] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:54 2022] DELETE /identity/v3/users/dd62172643c0474097b127fdff333b3b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:54.596849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac14b0b1ffc14b37b16ce0d19e98b32d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.607179 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac14b0b1ffc14b37b16ce0d19e98b32d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.607994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac14b0b1ffc14b37b16ce0d19e98b32d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.652231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 928/1830] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:54 2022] DELETE /identity/v3/users/ac14b0b1ffc14b37b16ce0d19e98b32d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:54.655610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff809-3f05-4642-a6c7-313a1b85c3d5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:54.655969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff809-3f05-4642-a6c7-313a1b85c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:54.656440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ff809-3f05-4642-a6c7-313a1b85c3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:54.709074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:54.709215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9a6ff809-3f05-4642-a6c7-313a1b85c3d5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:54.710677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:54.715555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9a6ff809-3f05-4642-a6c7-313a1b85c3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:54.723763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:54.839889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:54.851437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3c04-d30a-4ac3-b474-fbc491657329 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:54.859098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:54.860545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:54.861065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:54.861487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] PATH_INFO: `/v3/projects/20cee8a5f10c42e682d1ff7389118102` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:54.863792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cee8a5f10c42e682d1ff7389118102)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:54.866250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:54.938772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 903/1831] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:54.955146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cee8a5f10c42e682d1ff7389118102', 'request_id': 'req-c36d0ef9-2482-4c2a-9e38-a49b059548ef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.966879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cee8a5f10c42e682d1ff7389118102', 'request_id': 'req-c36d0ef9-2482-4c2a-9e38-a49b059548ef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:54.981262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cee8a5f10c42e682d1ff7389118102', 'request_id': 'req-c36d0ef9-2482-4c2a-9e38-a49b059548ef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:55.005185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] The token cache is being invalidate because project 20cee8a5f10c42e682d1ff7389118102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:55.007462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:55.008558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:55.014764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 929/1832] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:54 2022] DELETE /identity/v3/projects/20cee8a5f10c42e682d1ff7389118102 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:55.021294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111b8a0-7728-4401-8d99-8ab2c1a2653c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.021904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111b8a0-7728-4401-8d99-8ab2c1a2653c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.022329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111b8a0-7728-4401-8d99-8ab2c1a2653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.057093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f111b8a0-7728-4401-8d99-8ab2c1a2653c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:55.061076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:55.063294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.088296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f111b8a0-7728-4401-8d99-8ab2c1a2653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.212541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d0ef9-2482-4c2a-9e38-a49b059548ef admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:55.218558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832603f0-b2a6-4b9d-ac27-7e4243aa232e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:55.219739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832603f0-b2a6-4b9d-ac27-7e4243aa232e service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.219739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832603f0-b2a6-4b9d-ac27-7e4243aa232e service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.219953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832603f0-b2a6-4b9d-ac27-7e4243aa232e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.222401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-832603f0-b2a6-4b9d-ac27-7e4243aa232e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.323808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:55.327166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 904/1833] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:55.348528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4648e5-8fce-428c-89ac-8a22a1ecbc48 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.350760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4648e5-8fce-428c-89ac-8a22a1ecbc48 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.351919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4648e5-8fce-428c-89ac-8a22a1ecbc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.371303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832603f0-b2a6-4b9d-ac27-7e4243aa232e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:55.403322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832603f0-b2a6-4b9d-ac27-7e4243aa232e service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:55.483611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 930/1834] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:55.493986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe5f0-36a1-4be7-96b8-77ffbe789605 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.494342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe5f0-36a1-4be7-96b8-77ffbe789605 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.494661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe5f0-36a1-4be7-96b8-77ffbe789605 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.503396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 931/1835] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:16:55 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:55.514575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9a4648e5-8fce-428c-89ac-8a22a1ecbc48 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:55.519354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9a4648e5-8fce-428c-89ac-8a22a1ecbc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.560531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 905/1836] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:55.565308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe5f0-36a1-4be7-96b8-77ffbe789605 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:55.630855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe5f0-36a1-4be7-96b8-77ffbe789605 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:55.654121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae489c0-06f8-4288-9d3d-0b5f6cc0fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:55.654771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae489c0-06f8-4288-9d3d-0b5f6cc0fd91 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.655086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae489c0-06f8-4288-9d3d-0b5f6cc0fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.655357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae489c0-06f8-4288-9d3d-0b5f6cc0fd91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.656780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae489c0-06f8-4288-9d3d-0b5f6cc0fd91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:55.656780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae489c0-06f8-4288-9d3d-0b5f6cc0fd91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:55.658383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae489c0-06f8-4288-9d3d-0b5f6cc0fd91 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:55.698221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4648e5-8fce-428c-89ac-8a22a1ecbc48 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:55.710836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4648e5-8fce-428c-89ac-8a22a1ecbc48 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:55.717652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 932/1837] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:55.727711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:55.728492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.728871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.729175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.735851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:55.739806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:55.848809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569651-e057-4577-b9f4-100c0a7702e1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.849097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569651-e057-4577-b9f4-100c0a7702e1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.849438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36569651-e057-4577-b9f4-100c0a7702e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.875030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 906/1838] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:55 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:55.875030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:55.901426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-36569651-e057-4577-b9f4-100c0a7702e1 None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:55.903679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-36569651-e057-4577-b9f4-100c0a7702e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:56.081874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf69c-75a8-499a-a889-5c42fa51e312 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.093152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 933/1839] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:16:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:56.121790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.126511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.126511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.126734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.127404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.136468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.213470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 907/1840] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:55 2022] POST /identity/v3/users => generated 297 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:56.217914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569651-e057-4577-b9f4-100c0a7702e1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.240812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36569651-e057-4577-b9f4-100c0a7702e1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.271630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.272751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.272880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.273099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.273825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.275722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.306782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 934/1841] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:56.310973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.328220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab1428-8493-4428-aca2-9868ce213bd0 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.335835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fe6fc-bc03-42e0-b414-f6e364de0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.336603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe6fc-bc03-42e0-b414-f6e364de0d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.336947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe6fc-bc03-42e0-b414-f6e364de0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.337227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe6fc-bc03-42e0-b414-f6e364de0d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.338230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fe6fc-bc03-42e0-b414-f6e364de0d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.339797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fe6fc-bc03-42e0-b414-f6e364de0d9d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.363604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 908/1842] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:56.368228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.382598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602d80f-a008-4319-9f02-542c51dda30c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.387821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.388543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.388823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.389097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] PATH_INFO: `/v3/projects/a12001f84d834804b34c2ed693031586/users/74071b171b62480c8a8a635f2623eb34/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.426514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12001f84d834804b34c2ed693031586, user_id=74071b171b62480c8a8a635f2623eb34, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.429551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:56.458403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 935/1843] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:56 2022] PUT /identity/v3/projects/a12001f84d834804b34c2ed693031586/users/74071b171b62480c8a8a635f2623eb34/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:56.463962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.464372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.464849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.545057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] MFA Rules not processed for user `74071b171b62480c8a8a635f2623eb34`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:56.546683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:56.620929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:56.754168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 909/1844] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:56.759743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:56.973972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6bb9a-edb2-4e39-a62d-75ca89dd4f75 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:56.980331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:56.981009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:56.981288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:56.981613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:56.982366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:56.984448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:57.012260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:57.017471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:57.157880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 936/1845] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:56 2022] POST /identity/v3/projects => generated 393 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:57.159083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:57.231852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:57.294661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082e564-782e-41e9-8424-66b4a07f41e1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:57.387414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ba94f-7637-4335-8efe-5d02765b18e5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:57.404395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:57.405379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:57.405883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:57.406369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:57.407218 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:57.412450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:57.493013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 937/1846] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:57 2022] POST /identity/v3/users => generated 303 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:57.501498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:57.510155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:57.513081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:57.513453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:57.513688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:57.528308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:57.540934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:57.542641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:57.558631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0adbfe-c93e-4097-82b6-0ebde56f49e2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:57.583379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 910/1847] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:57.583910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:57.584307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:57.585334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:57.592013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:57.593621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] PATH_INFO: `/v3/projects/e56887aaad0d4ca1a132a273aa33e103` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:57.595570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56887aaad0d4ca1a132a273aa33e103)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:57.598777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:57.609785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016a1e-9273-4d24-aaaf-74fbbba19dcb service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:57.621273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:57.623232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:57.624006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:57.626130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:57.626885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:57.632586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:57.666540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 911/1848] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:57.668451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:57.696386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89a4c8-7791-4135-82f6-52c1d61b02f7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:57.709084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:57.709794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:57.712481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:57.713937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] PATH_INFO: `/v3/projects/df876b550b1e4c068cc67178c4e5a735/users/07993c5a1ab24f82906328f2701f7bbd/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:57.741847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56887aaad0d4ca1a132a273aa33e103', 'request_id': 'req-948d8129-0683-4178-b9dd-4b4ca3ef4c62'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:57.753350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df876b550b1e4c068cc67178c4e5a735, user_id=07993c5a1ab24f82906328f2701f7bbd, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:57.758629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56887aaad0d4ca1a132a273aa33e103', 'request_id': 'req-948d8129-0683-4178-b9dd-4b4ca3ef4c62'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:57.758930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:57.778616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56887aaad0d4ca1a132a273aa33e103', 'request_id': 'req-948d8129-0683-4178-b9dd-4b4ca3ef4c62'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:57.790531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 912/1849] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:57 2022] PUT /identity/v3/projects/df876b550b1e4c068cc67178c4e5a735/users/07993c5a1ab24f82906328f2701f7bbd/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:57.794545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:57.813185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] The token cache is being invalidate because project e56887aaad0d4ca1a132a273aa33e103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:57.814356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:57.815773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-948d8129-0683-4178-b9dd-4b4ca3ef4c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:57.819115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:57.820372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 938/1850] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:57 2022] DELETE /identity/v3/projects/e56887aaad0d4ca1a132a273aa33e103 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:57.826129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f4b9-a05b-4723-88f2-7f489dfaa8c3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:57.826410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f4b9-a05b-4723-88f2-7f489dfaa8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:57.826728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f4b9-a05b-4723-88f2-7f489dfaa8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:57.884893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e289f4b9-a05b-4723-88f2-7f489dfaa8c3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:57.886153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e289f4b9-a05b-4723-88f2-7f489dfaa8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:57.956904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985474a1-1e50-4094-ae9e-73509147c671 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:57.978159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:57.978783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:57.979094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:57.979499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:57.980161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:57.982009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.011821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 913/1851] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:58.014086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.027771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.053162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546bdc9-0dc2-49a2-b8bd-5587d692f28d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.065648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca359391-286d-4a47-abd1-94152d8cf4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.066311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca359391-286d-4a47-abd1-94152d8cf4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.066702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca359391-286d-4a47-abd1-94152d8cf4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.077330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca359391-286d-4a47-abd1-94152d8cf4d9 admin admin] PATH_INFO: `/v3/projects/df876b550b1e4c068cc67178c4e5a735/users/07993c5a1ab24f82906328f2701f7bbd/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.087488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca359391-286d-4a47-abd1-94152d8cf4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df876b550b1e4c068cc67178c4e5a735, user_id=07993c5a1ab24f82906328f2701f7bbd, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.097096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca359391-286d-4a47-abd1-94152d8cf4d9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.109612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 939/1852] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:58.118203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.119248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.119721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.149370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:58.152455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.157680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 914/1853] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:58 2022] PUT /identity/v3/projects/df876b550b1e4c068cc67178c4e5a735/users/07993c5a1ab24f82906328f2701f7bbd/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:58.174633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d572-951c-4157-bb21-14a03d75a425 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.175420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d572-951c-4157-bb21-14a03d75a425 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.177277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d572-951c-4157-bb21-14a03d75a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.261653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:58.320647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b670d572-951c-4157-bb21-14a03d75a425 None None] MFA Rules not processed for user `07993c5a1ab24f82906328f2701f7bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:58.324998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b670d572-951c-4157-bb21-14a03d75a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.366114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 940/1854] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:58.367154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.368627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.388852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d38327-52e1-4cd5-94de-007a041ba329 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.396988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.397983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.398441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.398891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] PATH_INFO: `/v3/projects/b7ddde7d93b54992891ef6714b17aee4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.400572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ddde7d93b54992891ef6714b17aee4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.405678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.500287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 915/1855] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:58.501609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670d572-951c-4157-bb21-14a03d75a425 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.511152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ddde7d93b54992891ef6714b17aee4', 'request_id': 'req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.516646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670d572-951c-4157-bb21-14a03d75a425 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.531881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ddde7d93b54992891ef6714b17aee4', 'request_id': 'req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.557315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ddde7d93b54992891ef6714b17aee4', 'request_id': 'req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.588116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] The token cache is being invalidate because project b7ddde7d93b54992891ef6714b17aee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:58.588415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.589396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.592388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 941/1856] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:58 2022] DELETE /identity/v3/projects/b7ddde7d93b54992891ef6714b17aee4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:58.595771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.598359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.678078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.683503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.686059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.686562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.687452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:58.692447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.704681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.751356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 916/1857] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:58.752914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.757720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.792665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c364f9-3087-4494-957f-352c1c94af7f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.812388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.813653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.814202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.814687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] PATH_INFO: `/v3/users/54fa5cedaf814518a403ec370ac9b168` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.817991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fa5cedaf814518a403ec370ac9b168)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.822892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.837847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:58.842247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2f66c-7057-4e9b-9280-55d1e6ed4a6d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.868591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.872531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.872808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.873075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.883825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.927614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fa5cedaf814518a403ec370ac9b168'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.928637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fa5cedaf814518a403ec370ac9b168'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.947597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fa5cedaf814518a403ec370ac9b168'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.966085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fa5cedaf814518a403ec370ac9b168'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:58.967119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fa5cedaf814518a403ec370ac9b168'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:59.057995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.060831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.062457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 917/1858] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:58 2022] DELETE /identity/v3/users/54fa5cedaf814518a403ec370ac9b168 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:59.066426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.068031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:59.080888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 942/1859] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:59.166557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.173665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:59.181648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7d864-a070-4a11-a57f-e62309639253 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.245804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f464c2-65b5-47a5-9378-0e9d98c685a6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.255290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.256799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.257724 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.258173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.259323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.262869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.265000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.265957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.267038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.267038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.271021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:59.327858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 918/1860] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:59 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:59.333365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.404505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.406812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.429885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 943/1861] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:59.479232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3cc4a-31b4-4757-af6c-b7f227172730 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.485489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.486276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.486617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.486960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.487910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.491152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.513862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:59.534005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 919/1862] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:59 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:59.535306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.554502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66cf09-9cab-4156-b5a9-f0c67bd0ad47 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.566038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.567444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.568042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.569182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.570192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.573087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.591573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.597768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 944/1863] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:59.605852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f832f-b83b-473d-86a5-86b92b1ff49b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.620304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12b8f6-b604-4ac1-9345-61e52314348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.622155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12b8f6-b604-4ac1-9345-61e52314348f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.622817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12b8f6-b604-4ac1-9345-61e52314348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.623895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12b8f6-b604-4ac1-9345-61e52314348f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.624571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12b8f6-b604-4ac1-9345-61e52314348f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.629593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12b8f6-b604-4ac1-9345-61e52314348f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.677711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.684579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 920/1864] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:59.690797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53182e-5b12-464e-be91-980cfd53d8bb admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.700640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9990-4793-45c7-a750-fc2de5d12238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.701339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9990-4793-45c7-a750-fc2de5d12238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.701699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9990-4793-45c7-a750-fc2de5d12238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.702089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9990-4793-45c7-a750-fc2de5d12238 admin admin] PATH_INFO: `/v3/projects/4d7cd8d8ca684d478bd35916f0b5b9c4/users/1dcd5ac832c342189a570cb9b2f02392/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.758572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9990-4793-45c7-a750-fc2de5d12238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7cd8d8ca684d478bd35916f0b5b9c4, user_id=1dcd5ac832c342189a570cb9b2f02392, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.766690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9990-4793-45c7-a750-fc2de5d12238 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.803934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f78499-6409-4c8d-9309-54df732da1fe None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.804252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f78499-6409-4c8d-9309-54df732da1fe None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.805548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f78499-6409-4c8d-9309-54df732da1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.809453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 945/1865] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:59 2022] PUT /identity/v3/projects/4d7cd8d8ca684d478bd35916f0b5b9c4/users/1dcd5ac832c342189a570cb9b2f02392/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:59.846167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-36f78499-6409-4c8d-9309-54df732da1fe None None] MFA Rules not processed for user `1dcd5ac832c342189a570cb9b2f02392`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:59.848561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-36f78499-6409-4c8d-9309-54df732da1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:59.937991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812c8b-e025-474d-b5f7-1c6b7fddb2f7 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.938550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812c8b-e025-474d-b5f7-1c6b7fddb2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.939031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812c8b-e025-474d-b5f7-1c6b7fddb2f7 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.940958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 946/1866] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:59.952038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.952562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.953052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.976864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 921/1867] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:16:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:59.982038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f78499-6409-4c8d-9309-54df732da1fe None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.004031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:00.004031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.113232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f78499-6409-4c8d-9309-54df732da1fe None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.128515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adea97-4606-4999-a546-454305471554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.130534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adea97-4606-4999-a546-454305471554 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.131592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adea97-4606-4999-a546-454305471554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.132406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adea97-4606-4999-a546-454305471554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.136907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adea97-4606-4999-a546-454305471554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.140297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adea97-4606-4999-a546-454305471554 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.161319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 947/1868] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:16:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:00.176465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.179287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.200863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5c861-b2cc-4634-8271-05906bd3647b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.206986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.208851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.209127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.209444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] PATH_INFO: `/v3/projects/26405503f9be45ef96f86947c64c3f89` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.211054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26405503f9be45ef96f86947c64c3f89)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.213282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.223573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 922/1869] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:59 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:00.224516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adea97-4606-4999-a546-454305471554 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.230093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:00.297324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26405503f9be45ef96f86947c64c3f89', 'request_id': 'req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:00.303598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26405503f9be45ef96f86947c64c3f89', 'request_id': 'req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:00.306385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adea97-4606-4999-a546-454305471554 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.312282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:00.312479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26405503f9be45ef96f86947c64c3f89', 'request_id': 'req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:00.326781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] The token cache is being invalidate because project 26405503f9be45ef96f86947c64c3f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:00.326944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:00.327594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:00.329130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 948/1870] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:00 2022] DELETE /identity/v3/projects/26405503f9be45ef96f86947c64c3f89 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:00.329940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.331276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.386027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec93062-9c63-41f2-ada5-d7c004726d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.386963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93062-9c63-41f2-ada5-d7c004726d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.387344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93062-9c63-41f2-ada5-d7c004726d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.387727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93062-9c63-41f2-ada5-d7c004726d6a admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.388449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec93062-9c63-41f2-ada5-d7c004726d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.390502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec93062-9c63-41f2-ada5-d7c004726d6a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.425180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9168b-8c7e-4c23-afd6-7ca81a51da1e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.428862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 923/1871] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:00 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:00.428862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.428862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.428862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.437384 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7de6b-49d5-40a6-bd7a-bf3bb88f5e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.438206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7de6b-49d5-40a6-bd7a-bf3bb88f5e78 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.438636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7de6b-49d5-40a6-bd7a-bf3bb88f5e78 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.439070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7de6b-49d5-40a6-bd7a-bf3bb88f5e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.441181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-eda7de6b-49d5-40a6-bd7a-bf3bb88f5e78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.454599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:00.455516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7de6b-49d5-40a6-bd7a-bf3bb88f5e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.456453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.457757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7de6b-49d5-40a6-bd7a-bf3bb88f5e78 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.469171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 924/1872] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:00.470195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.471751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.490302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d185b9-238c-4fd4-a352-9044ca8154ab None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.496490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.497064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 949/1873] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:00.497192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.497419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.497739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.498390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.499923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dd0d4-bd83-4ee8-8695-dc383703babd None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.500276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.501681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dd0d4-bd83-4ee8-8695-dc383703babd None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.502132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dd0d4-bd83-4ee8-8695-dc383703babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.515797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 925/1874] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:00.531399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.553617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7be6a-6c36-4387-91f2-bac9d0eb1a36 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.559366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f09dd0d4-bd83-4ee8-8695-dc383703babd None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:00.560341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f09dd0d4-bd83-4ee8-8695-dc383703babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.565238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.566244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.566569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.567704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] PATH_INFO: `/v3/projects/c2c8a3127fe94b3ba11beccd424bace1/users/26f629ed5d7644839edcd065d8f0c1b5/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.575912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 950/1875] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:00.579883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dd0d4-bd83-4ee8-8695-dc383703babd None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.600130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dd0d4-bd83-4ee8-8695-dc383703babd None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.606983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.607593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.607869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.608140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.608790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:00.609586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.609724 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c8a3127fe94b3ba11beccd424bace1, user_id=26f629ed5d7644839edcd065d8f0c1b5, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.610676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.612301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.628268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 951/1876] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:17:00.630419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.642515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e169c-18a2-43d1-8138-9125213e9dec admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.643299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 926/1877] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:00 2022] PUT /identity/v3/projects/c2c8a3127fe94b3ba11beccd424bace1/users/26f629ed5d7644839edcd065d8f0c1b5/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:00.647495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.734025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2072b-43cd-4d87-a8e2-3ee42a70ce80 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.737193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.737885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.738189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.739922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.740554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.741321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.742125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.742532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.742668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.742856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.743948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.746214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.748933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:00.764264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 927/1878] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:00.774244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.784949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63e7a-d511-414c-8e64-eb1e9f413aaa admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.791609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ff05-7dbe-4bc2-a640-4f2dabcc3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.792340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ff05-7dbe-4bc2-a640-4f2dabcc3780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.792617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ff05-7dbe-4bc2-a640-4f2dabcc3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.792890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ff05-7dbe-4bc2-a640-4f2dabcc3780 admin admin] PATH_INFO: `/v3/projects/c2c8a3127fe94b3ba11beccd424bace1/users/26f629ed5d7644839edcd065d8f0c1b5/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.794921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ff05-7dbe-4bc2-a640-4f2dabcc3780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c8a3127fe94b3ba11beccd424bace1, user_id=26f629ed5d7644839edcd065d8f0c1b5, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.797579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ff05-7dbe-4bc2-a640-4f2dabcc3780 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.802206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 952/1879] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:00 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:00.803514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.810828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 928/1880] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:00 2022] PUT /identity/v3/projects/c2c8a3127fe94b3ba11beccd424bace1/users/26f629ed5d7644839edcd065d8f0c1b5/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:00.821727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.822188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.822620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.858369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] MFA Rules not processed for user `26f629ed5d7644839edcd065d8f0c1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:00.859922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.876407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae362086-507e-40a1-b1f7-833bfc0fc77e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.896123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:00.941917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.942529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.942809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.943082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.943715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:00.945879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:00.961795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 929/1881] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:00.964329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.966158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:00.972083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 953/1882] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:00 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:00.976415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:00.987617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521c183-3b5e-45a7-bc82-c1e500a8d4a9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:00.996038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:00.996872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:00.997159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:00.997557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:00.998181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.000110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.012680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 954/1883] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:01.018688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:01.031663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f82a1-3ed2-44a2-960c-b545bed261a6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:01.038870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:01.039609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.039852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.040130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.040775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.042899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.062401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 955/1884] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:01.062877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492c388-e95e-4bdd-9db7-80d7df79ad24 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:01.063833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:01.070850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cc665-d872-4127-99c4-e253d857b8b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:01.071538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cc665-d872-4127-99c4-e253d857b8b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.071812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cc665-d872-4127-99c4-e253d857b8b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.072076 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cc665-d872-4127-99c4-e253d857b8b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.086281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580f58-f235-4778-97a4-41c092d7da43 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:01.087335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cc665-d872-4127-99c4-e253d857b8b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.089653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cc665-d872-4127-99c4-e253d857b8b5 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.091569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:01.092218 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.092492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.092760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] PATH_INFO: `/v3/projects/de515b3de6a64d48881aeb15ac5fcbc3/users/228b982ceec74837b47643642ff118c6/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.102124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 930/1885] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:01.111678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de515b3de6a64d48881aeb15ac5fcbc3, user_id=228b982ceec74837b47643642ff118c6, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.117167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.137138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 956/1886] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:01 2022] PUT /identity/v3/projects/de515b3de6a64d48881aeb15ac5fcbc3/users/228b982ceec74837b47643642ff118c6/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:01.148936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9911-549c-4b54-a693-b76e31b45d8f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.149408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9911-549c-4b54-a693-b76e31b45d8f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.149890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9911-549c-4b54-a693-b76e31b45d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.199577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-221f9911-549c-4b54-a693-b76e31b45d8f None None] MFA Rules not processed for user `228b982ceec74837b47643642ff118c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:01.201435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-221f9911-549c-4b54-a693-b76e31b45d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:01.407252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:01.414600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 931/1887] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:01.467974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:01.497358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167e5c-a6c7-4d09-84a7-76223f81c77c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:01.510654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:01.511308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.511587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.511860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.512523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.514633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.573274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 957/1888] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:01 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:01.575869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9911-549c-4b54-a693-b76e31b45d8f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:01.607998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9911-549c-4b54-a693-b76e31b45d8f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:01.721965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:01.730104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:01.731642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.732093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.732505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.733285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.735794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.770822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 932/1889] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:01 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:01.772326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:01.788894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf09e6-e56e-4e22-9e54-2f1981a535ee admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:01.800493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:01.801426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.801750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.802071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.802714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.804370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.819795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 958/1890] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:01.825019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:01.842764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a14b-778d-4009-a9da-fdd3f8612771 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:01.860022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:01.862996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:01.863283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:01.866799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] PATH_INFO: `/v3/projects/41a4312e35d74469a65faead63cb32a2/users/b90a675a0c0e49e4937bea2ad26c2197/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:01.939927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a4312e35d74469a65faead63cb32a2, user_id=b90a675a0c0e49e4937bea2ad26c2197, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:01.944065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:01.974038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 933/1891] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:01 2022] PUT /identity/v3/projects/41a4312e35d74469a65faead63cb32a2/users/b90a675a0c0e49e4937bea2ad26c2197/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:01.977639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:01.989716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43e58c-8ddb-48bb-9ff3-1abb6f37a2ad admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:02.140498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb45397-bc55-459c-9508-456c03fa156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:02.142527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb45397-bc55-459c-9508-456c03fa156c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:02.142993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb45397-bc55-459c-9508-456c03fa156c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:02.143472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb45397-bc55-459c-9508-456c03fa156c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:02.144445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb45397-bc55-459c-9508-456c03fa156c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:02.149215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb45397-bc55-459c-9508-456c03fa156c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:02.201756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 959/1892] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:02.204555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:02.222684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161be68-b523-400c-ba20-2c3efaa2284b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:02.243556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:02.244239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:02.250689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:02.251012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] PATH_INFO: `/v3/projects/41a4312e35d74469a65faead63cb32a2/users/b90a675a0c0e49e4937bea2ad26c2197/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:02.253639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a4312e35d74469a65faead63cb32a2, user_id=b90a675a0c0e49e4937bea2ad26c2197, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:02.257003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:02.317051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 934/1893] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:02 2022] PUT /identity/v3/projects/41a4312e35d74469a65faead63cb32a2/users/b90a675a0c0e49e4937bea2ad26c2197/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:02.324407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:02.325131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:02.325664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:02.412347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:02.419977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] MFA Rules not processed for user `b90a675a0c0e49e4937bea2ad26c2197`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:02.421214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:02.588663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 960/1894] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:02.630674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:02.631375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:02.694900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f271a-5d95-4704-bb09-81e8b6f911a3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:02.706556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:02.709236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:02.709761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:02.710221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] PATH_INFO: `/v3/users/1dcd5ac832c342189a570cb9b2f02392` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:02.710927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:02.714095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dcd5ac832c342189a570cb9b2f02392)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:02.721255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:02.755216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e004b-8de7-4a3a-844c-a86337da2773 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:02.759698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad215c-e5c6-442a-ac74-4b6326cceda9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:02.760317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad215c-e5c6-442a-ac74-4b6326cceda9 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:02.760593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad215c-e5c6-442a-ac74-4b6326cceda9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:02.761872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad215c-e5c6-442a-ac74-4b6326cceda9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:02.781929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad215c-e5c6-442a-ac74-4b6326cceda9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:02.783056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad215c-e5c6-442a-ac74-4b6326cceda9 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:02.808469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 961/1895] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:02.857734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dcd5ac832c342189a570cb9b2f02392'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:02.859933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dcd5ac832c342189a570cb9b2f02392'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:02.876671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dcd5ac832c342189a570cb9b2f02392'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:02.892726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dcd5ac832c342189a570cb9b2f02392'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:02.894498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dcd5ac832c342189a570cb9b2f02392'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:02.954417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 935/1896] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:02 2022] DELETE /identity/v3/users/1dcd5ac832c342189a570cb9b2f02392 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:02.960792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:02.961105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:02.961458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:03.000317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:03.002194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:03.002794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:03.009704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:03.077494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:03.111511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 962/1897] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:03.130100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0756589-3dca-4abf-80d4-1d614c4c2953 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:03.136937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:03.137592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:03.137883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:03.138273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:03.138749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:03.140206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:03.144719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:03.266553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2147d-7a7b-463c-9d22-42919cf227d9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:03.272587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddbe71-3665-4c6f-a8ae-c53643c87f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:03.274356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:03.274669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddbe71-3665-4c6f-a8ae-c53643c87f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:03.275092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddbe71-3665-4c6f-a8ae-c53643c87f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:03.275507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddbe71-3665-4c6f-a8ae-c53643c87f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:03.276434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:03.288113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddbe71-3665-4c6f-a8ae-c53643c87f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:03.289609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 936/1898] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:03.298819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddbe71-3665-4c6f-a8ae-c53643c87f1e service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:03.314293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 963/1899] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:03.769543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:03.771222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:03.794223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0169a6-7818-4d7b-b8c8-034d82aea6b8 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:03.805270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:03.805969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:03.806253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:03.806530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] PATH_INFO: `/v3/users/228b982ceec74837b47643642ff118c6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:03.809419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228b982ceec74837b47643642ff118c6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:03.815928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:03.922498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228b982ceec74837b47643642ff118c6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:03.923375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228b982ceec74837b47643642ff118c6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:03.936709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228b982ceec74837b47643642ff118c6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:03.949262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228b982ceec74837b47643642ff118c6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:03.950367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228b982ceec74837b47643642ff118c6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:03.981774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 937/1900] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:03 2022] DELETE /identity/v3/users/228b982ceec74837b47643642ff118c6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:03.986471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:03.987438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:03.987921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:04.015995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:04.017999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:04.058885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:04.060778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:04.102442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 964/1901] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:04.135286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:04.146351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:04.182911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c473-02c8-4c46-9528-81c3a3fb91c8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:04.183929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:04.193149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:04.194174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:04.194699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:04.195037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] PATH_INFO: `/v3/users/74071b171b62480c8a8a635f2623eb34` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:04.196602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74071b171b62480c8a8a635f2623eb34)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:04.199976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:04.215393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:04.281581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74071b171b62480c8a8a635f2623eb34'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.282533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74071b171b62480c8a8a635f2623eb34'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.291596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74071b171b62480c8a8a635f2623eb34'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.302476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74071b171b62480c8a8a635f2623eb34'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.303044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16316c7-ab49-4c34-9864-f8373b9d7c38 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:04.303362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59f40e28-6d47-48f9-a392-fb5f3b32cb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74071b171b62480c8a8a635f2623eb34'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.309295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:04.309969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:04.310302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:04.310572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:04.312607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:04.331167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:04.333283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:04.339263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 938/1902] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:04 2022] DELETE /identity/v3/users/74071b171b62480c8a8a635f2623eb34 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:04.343564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:04.345088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:04.345685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:04.355658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 965/1903] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:04.397181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:04.398726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:04.489210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 939/1904] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:04.524381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:04.526032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:04.540787 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccf9df-f499-4b7d-a950-8e36f2194cd3 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:04.657090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:04.657939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:04.658869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:04.659247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:04.682848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:04.685023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:04.703257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 966/1905] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:04.729192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:04.731018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:04.751760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f24690-d618-4afd-9ef2-4272b1096adc None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:04.763762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:04.765676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:04.767382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:04.767687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] PATH_INFO: `/v3/projects/4d7cd8d8ca684d478bd35916f0b5b9c4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:04.771222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7cd8d8ca684d478bd35916f0b5b9c4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:04.775639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:04.884051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7cd8d8ca684d478bd35916f0b5b9c4', 'request_id': 'req-0d914a14-889b-4ae7-8b71-42b80acce0b3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.901283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7cd8d8ca684d478bd35916f0b5b9c4', 'request_id': 'req-0d914a14-889b-4ae7-8b71-42b80acce0b3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.918376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7cd8d8ca684d478bd35916f0b5b9c4', 'request_id': 'req-0d914a14-889b-4ae7-8b71-42b80acce0b3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.932268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:04.937145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] The token cache is being invalidate because project 4d7cd8d8ca684d478bd35916f0b5b9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:04.937456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.938160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:04.943878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 940/1906] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:04 2022] DELETE /identity/v3/projects/4d7cd8d8ca684d478bd35916f0b5b9c4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:04.949647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:04.973731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6f711-c9c9-4d6c-bcad-d139c8b8cef0 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:05.096018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:05.097393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:05.116300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:05.116946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:05.117220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:05.117492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] PATH_INFO: `/v3/users/26f629ed5d7644839edcd065d8f0c1b5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:05.118978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f629ed5d7644839edcd065d8f0c1b5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:05.120890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:05.267358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f629ed5d7644839edcd065d8f0c1b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.268056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f629ed5d7644839edcd065d8f0c1b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.294716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f629ed5d7644839edcd065d8f0c1b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.296903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:05.300192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d914a14-889b-4ae7-8b71-42b80acce0b3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:05.307809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:05.308480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:05.308762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:05.309045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] PATH_INFO: `/v3/projects/de515b3de6a64d48881aeb15ac5fcbc3` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:05.311912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de515b3de6a64d48881aeb15ac5fcbc3)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:05.312066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f629ed5d7644839edcd065d8f0c1b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.312820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f629ed5d7644839edcd065d8f0c1b5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.313964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:05.344134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 967/1907] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:04 2022] DELETE /identity/v3/users/26f629ed5d7644839edcd065d8f0c1b5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:05.394536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de515b3de6a64d48881aeb15ac5fcbc3', 'request_id': 'req-01566101-f63c-4911-a372-f0dac1345a28'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.438152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de515b3de6a64d48881aeb15ac5fcbc3', 'request_id': 'req-01566101-f63c-4911-a372-f0dac1345a28'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.454476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de515b3de6a64d48881aeb15ac5fcbc3', 'request_id': 'req-01566101-f63c-4911-a372-f0dac1345a28'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.477744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] The token cache is being invalidate because project de515b3de6a64d48881aeb15ac5fcbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:05.478048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.478733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.480938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 941/1908] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:05 2022] DELETE /identity/v3/projects/de515b3de6a64d48881aeb15ac5fcbc3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:05.484504 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:05.486274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:05.533479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:05.535902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:05.636127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58fd95-710b-4388-84c6-8e6821aefeea admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:05.737775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01566101-f63c-4911-a372-f0dac1345a28 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:05.751477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:05.753040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:05.753386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:05.755200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] PATH_INFO: `/v3/projects/a12001f84d834804b34c2ed693031586` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:05.778849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12001f84d834804b34c2ed693031586)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:05.791994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:05.849114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:05.849673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:05.849949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:05.852803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] PATH_INFO: `/v3/users/b90a675a0c0e49e4937bea2ad26c2197` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:05.852803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90a675a0c0e49e4937bea2ad26c2197)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:05.853810 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:05.885572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:05.909776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12001f84d834804b34c2ed693031586', 'request_id': 'req-22b69421-aac3-487b-900e-4f541ce24082'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.927780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12001f84d834804b34c2ed693031586', 'request_id': 'req-22b69421-aac3-487b-900e-4f541ce24082'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.943006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12001f84d834804b34c2ed693031586', 'request_id': 'req-22b69421-aac3-487b-900e-4f541ce24082'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.974559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] The token cache is being invalidate because project a12001f84d834804b34c2ed693031586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:05.974853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.975536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-22b69421-aac3-487b-900e-4f541ce24082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.975669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90a675a0c0e49e4937bea2ad26c2197'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.977294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 942/1909] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:05 2022] DELETE /identity/v3/projects/a12001f84d834804b34c2ed693031586 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:05.978034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90a675a0c0e49e4937bea2ad26c2197'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:05.978330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06709-5192-4ad8-b488-b60ff9959528 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:05.978610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06709-5192-4ad8-b488-b60ff9959528 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:05.978927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f06709-5192-4ad8-b488-b60ff9959528 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:05.980494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 943/1910] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:17:05.981157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f06709-5192-4ad8-b488-b60ff9959528 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:05.987544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b6f06709-5192-4ad8-b488-b60ff9959528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:05.995099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90a675a0c0e49e4937bea2ad26c2197'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.003396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90a675a0c0e49e4937bea2ad26c2197'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.005315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ce0f2f0c-84e0-48d1-b095-9c1707c021d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90a675a0c0e49e4937bea2ad26c2197'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.029609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 968/1911] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:05 2022] DELETE /identity/v3/users/b90a675a0c0e49e4937bea2ad26c2197 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:06.032603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:06.033133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:06.034115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:06.058411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:06.061015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:06.068609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:06.085416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f06709-5192-4ad8-b488-b60ff9959528 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:06.158520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 969/1912] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:17:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:06.174345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:06.176294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:06.180560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:06.181201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:06.181478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:06.181793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] PATH_INFO: `/v3/users/07993c5a1ab24f82906328f2701f7bbd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:06.182911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=07993c5a1ab24f82906328f2701f7bbd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:06.185499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:06.200967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a61336-d26a-4b41-aeeb-6eceef5e8dc3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:06.217493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:06.219886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:06.220171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:06.220505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:06.235374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:06.243217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:06.261481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07993c5a1ab24f82906328f2701f7bbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.262855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07993c5a1ab24f82906328f2701f7bbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.263968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 970/1913] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:06.289607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07993c5a1ab24f82906328f2701f7bbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.309527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07993c5a1ab24f82906328f2701f7bbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.310933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0bd807b1-e6a5-41d5-a9c2-81f2a9fbaf9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07993c5a1ab24f82906328f2701f7bbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.317930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:06.347139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 944/1914] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:05 2022] DELETE /identity/v3/users/07993c5a1ab24f82906328f2701f7bbd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:06.564998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:06.566525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:06.591896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5a130-d11a-49ec-92bb-7e2622e8c78d service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:06.735948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:06.736605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:06.736881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:06.737191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] PATH_INFO: `/v3/projects/c2c8a3127fe94b3ba11beccd424bace1` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:06.741017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c8a3127fe94b3ba11beccd424bace1)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:06.745650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:06.868806 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c8a3127fe94b3ba11beccd424bace1', 'request_id': 'req-304fb868-f541-4feb-af7a-d3aa738fafe9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.878449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c8a3127fe94b3ba11beccd424bace1', 'request_id': 'req-304fb868-f541-4feb-af7a-d3aa738fafe9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.893994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c8a3127fe94b3ba11beccd424bace1', 'request_id': 'req-304fb868-f541-4feb-af7a-d3aa738fafe9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.908747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] The token cache is being invalidate because project c2c8a3127fe94b3ba11beccd424bace1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:06.909125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.909823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-304fb868-f541-4feb-af7a-d3aa738fafe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:06.916499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 971/1915] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:06 2022] DELETE /identity/v3/projects/c2c8a3127fe94b3ba11beccd424bace1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:06.918565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:06.919023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:06.919443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:06.947608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:06.950185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.057231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 945/1916] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:07.058397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cfdc2-00d5-466a-a41d-f0939c532c1f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.058691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cfdc2-00d5-466a-a41d-f0939c532c1f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.059052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cfdc2-00d5-466a-a41d-f0939c532c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.104875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2a9cfdc2-00d5-466a-a41d-f0939c532c1f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:07.107725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2a9cfdc2-00d5-466a-a41d-f0939c532c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.108760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.110939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.133739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 972/1917] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:07.138669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cfdc2-00d5-466a-a41d-f0939c532c1f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.149221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cfdc2-00d5-466a-a41d-f0939c532c1f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.154517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.155236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.155607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.155966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.157257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:07.157738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.160235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.173581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:07.178871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddae93d-a44b-4c26-94b3-5c8c5cea8da3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.186623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 973/1918] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:07.190228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.203951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.204667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.204950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.205228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] PATH_INFO: `/v3/projects/41a4312e35d74469a65faead63cb32a2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.211779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1742b-47ec-4194-93ac-59584faf3e33 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.211954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a4312e35d74469a65faead63cb32a2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.216999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.226497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.227345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.227712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.228074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.228796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.231822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.276053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 974/1919] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:07.277353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.411543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a4312e35d74469a65faead63cb32a2', 'request_id': 'req-f082fecf-8ebd-499c-bfab-06c9829be7d8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.434157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a4312e35d74469a65faead63cb32a2', 'request_id': 'req-f082fecf-8ebd-499c-bfab-06c9829be7d8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.446943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a4312e35d74469a65faead63cb32a2', 'request_id': 'req-f082fecf-8ebd-499c-bfab-06c9829be7d8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.484246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] The token cache is being invalidate because project 41a4312e35d74469a65faead63cb32a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:07.484610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.488212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847d864-736c-4807-9c38-c3b8d09edc0f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.488503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f082fecf-8ebd-499c-bfab-06c9829be7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.491183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 946/1920] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:07 2022] DELETE /identity/v3/projects/41a4312e35d74469a65faead63cb32a2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:07.497695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.498057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.498457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.542408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:07.543792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.620301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ef21d-d312-4e97-ac85-f339926cc0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.621874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef21d-d312-4e97-ac85-f339926cc0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.622183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef21d-d312-4e97-ac85-f339926cc0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.623387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef21d-d312-4e97-ac85-f339926cc0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.626910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ef21d-d312-4e97-ac85-f339926cc0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.633249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ef21d-d312-4e97-ac85-f339926cc0f8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.649573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 947/1921] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:07.649573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.657900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.672390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35886acb-b667-4e54-a44a-677237c20be1 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.680040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 975/1922] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:07.681408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.681718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.681993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.683363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.684176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.684454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.684723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] PATH_INFO: `/v3/projects/df876b550b1e4c068cc67178c4e5a735` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.685958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df876b550b1e4c068cc67178c4e5a735)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.688812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.693749 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:07.703585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:07.705022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.716265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 976/1923] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:07.717058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.718378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.731405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce454c75-0099-41a6-96d7-f2be32ab4c0c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.736906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.737621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.737910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.738080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.738907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.740809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.753696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 977/1924] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:07.753696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.756318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df876b550b1e4c068cc67178c4e5a735', 'request_id': 'req-111354c9-5eaa-409b-9546-f6904f8603d7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.768640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34986ac5-ef98-42c4-93df-4c56ab934636 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.772570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df876b550b1e4c068cc67178c4e5a735', 'request_id': 'req-111354c9-5eaa-409b-9546-f6904f8603d7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.779060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df876b550b1e4c068cc67178c4e5a735', 'request_id': 'req-111354c9-5eaa-409b-9546-f6904f8603d7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.790435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] The token cache is being invalidate because project df876b550b1e4c068cc67178c4e5a735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:07.790716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.791377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:07.792910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 948/1925] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:07 2022] DELETE /identity/v3/projects/df876b550b1e4c068cc67178c4e5a735 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:07.796029 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.796029 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.820729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:07.827453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e553b0-297a-4c7b-9edf-a44db234d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.828586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e553b0-297a-4c7b-9edf-a44db234d64d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.828938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e553b0-297a-4c7b-9edf-a44db234d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.829436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e553b0-297a-4c7b-9edf-a44db234d64d admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.830340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e553b0-297a-4c7b-9edf-a44db234d64d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:07.831004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e553b0-297a-4c7b-9edf-a44db234d64d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.834245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e553b0-297a-4c7b-9edf-a44db234d64d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.847437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 978/1926] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:07.848693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e461-d636-4a11-a894-b14c4dcc1344 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.849080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e461-d636-4a11-a894-b14c4dcc1344 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.849354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e461-d636-4a11-a894-b14c4dcc1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.861942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111354c9-5eaa-409b-9546-f6904f8603d7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.867176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.867790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.868078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.868481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.869155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.871059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.872850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d7f4e461-d636-4a11-a894-b14c4dcc1344 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:07.874254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d7f4e461-d636-4a11-a894-b14c4dcc1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.883045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 949/1927] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:07.883418 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 979/1928] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:07.883858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.885490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:07.886941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4e461-d636-4a11-a894-b14c4dcc1344 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:07.901344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4e461-d636-4a11-a894-b14c4dcc1344 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.908333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb1e4b-704c-49fa-b8ae-72a717ced800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.908644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd2363-d537-4172-ab65-31d25e5f7b56 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:07.909057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb1e4b-704c-49fa-b8ae-72a717ced800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.909336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb1e4b-704c-49fa-b8ae-72a717ced800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.909642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb1e4b-704c-49fa-b8ae-72a717ced800 admin admin] PATH_INFO: `/v3/projects/55679cee4374470d97b5adc37dc0ff85/users/204f17b921654e19812a9d4c55e760bb/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.914465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0973005-268d-4bee-9377-e17e857ead97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:07.915160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0973005-268d-4bee-9377-e17e857ead97 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.915548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0973005-268d-4bee-9377-e17e857ead97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.915920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0973005-268d-4bee-9377-e17e857ead97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.916656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0973005-268d-4bee-9377-e17e857ead97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.918828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0973005-268d-4bee-9377-e17e857ead97 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.925442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb1e4b-704c-49fa-b8ae-72a717ced800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55679cee4374470d97b5adc37dc0ff85, user_id=204f17b921654e19812a9d4c55e760bb, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:07.928650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb1e4b-704c-49fa-b8ae-72a717ced800 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:07.953549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 980/1929] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:07 2022] PUT /identity/v3/projects/55679cee4374470d97b5adc37dc0ff85/users/204f17b921654e19812a9d4c55e760bb/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:07.953549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b016-daa9-4653-9d34-630b2f137063 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.953549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b016-daa9-4653-9d34-630b2f137063 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.953549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b016-daa9-4653-9d34-630b2f137063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.963866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 950/1930] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:07.967168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd6c6-a6ce-4c11-b24b-2cc6d7722ec9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:07.969000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd6c6-a6ce-4c11-b24b-2cc6d7722ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:07.969428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd6c6-a6ce-4c11-b24b-2cc6d7722ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:07.971436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9af1b016-daa9-4653-9d34-630b2f137063 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:07.972676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9af1b016-daa9-4653-9d34-630b2f137063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.009239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-526dd6c6-a6ce-4c11-b24b-2cc6d7722ec9 None None] MFA Rules not processed for user `204f17b921654e19812a9d4c55e760bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:08.010767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-526dd6c6-a6ce-4c11-b24b-2cc6d7722ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.046868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 981/1931] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:08.050143 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1b016-daa9-4653-9d34-630b2f137063 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.059950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1b016-daa9-4653-9d34-630b2f137063 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.067846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.068620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.068907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.069177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.070279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.072439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.089338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:08.100676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 982/1932] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:08 2022] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:08.105095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.105708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 951/1933] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:08.107073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dd6c6-a6ce-4c11-b24b-2cc6d7722ec9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.120409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dd6c6-a6ce-4c11-b24b-2cc6d7722ec9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.122370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa378c-525f-4e11-96f4-d8546c44bbec admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.126652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.127523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.127939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.128351 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.128477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.129643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.129931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.130202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.130850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:08.131088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.131201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.132896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.133406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.144132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 952/1934] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:08.144892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.149694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 983/1935] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:08.149852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.149968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.158839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe00e12-58df-4c74-83f4-a20847afef9f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.163545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.164119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.164398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.164667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.165326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.166964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.177737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 984/1936] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:08.178870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.188410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111ee75-60fc-4f5a-8ce1-293962d35371 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.194605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.195190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.195469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.195733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.196348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.198248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.207634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d7a9-47d0-4ca6-b673-75f4bc78ccb1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.211851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.212463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.212742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.213012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.225349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.225349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.233178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 985/1937] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:08 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:08.233178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.235147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 953/1938] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:08.239429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.255187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1f3f9-b196-4461-88e7-d32f0530e9d2 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.320374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:08.325025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5a53f-5752-4efb-8cdc-26199ecb983a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.340159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.341613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.341613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.341803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] PATH_INFO: `/v3/projects/da7d6de23e954153a5b215141ad4ee12/users/26a8808b5c5b41da9fd5667084441c87/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.362770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7d6de23e954153a5b215141ad4ee12, user_id=26a8808b5c5b41da9fd5667084441c87, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.364437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817d4e4-944a-4aa4-8bba-dbd330ec194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.365239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d4e4-944a-4aa4-8bba-dbd330ec194f admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.366274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.366706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d4e4-944a-4aa4-8bba-dbd330ec194f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.367174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d4e4-944a-4aa4-8bba-dbd330ec194f admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.367949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817d4e4-944a-4aa4-8bba-dbd330ec194f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.373501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817d4e4-944a-4aa4-8bba-dbd330ec194f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.396606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 986/1939] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:08 2022] PUT /identity/v3/projects/da7d6de23e954153a5b215141ad4ee12/users/26a8808b5c5b41da9fd5667084441c87/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:08.397174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.435835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 954/1940] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:08 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:08.444128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d9a46-92b1-45a4-926b-c15a880b921f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.444421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d9a46-92b1-45a4-926b-c15a880b921f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.446723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d9a46-92b1-45a4-926b-c15a880b921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.493301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b64d9a46-92b1-45a4-926b-c15a880b921f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:08.495751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b64d9a46-92b1-45a4-926b-c15a880b921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.553071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c350-6a31-4f4d-963d-8d0f69f14487 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.569138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.570057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.570350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.570596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] PATH_INFO: `/v3/users/204f17b921654e19812a9d4c55e760bb` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.572020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204f17b921654e19812a9d4c55e760bb)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.576647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.653624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 955/1941] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:08.655018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d9a46-92b1-45a4-926b-c15a880b921f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.669594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d9a46-92b1-45a4-926b-c15a880b921f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.675986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.677328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.678271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.682037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204f17b921654e19812a9d4c55e760bb'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:08.682792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204f17b921654e19812a9d4c55e760bb'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:08.690509 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.691624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.693426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.699427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204f17b921654e19812a9d4c55e760bb'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:08.709086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 956/1942] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:08.710021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.711919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.718313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204f17b921654e19812a9d4c55e760bb'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:08.719224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204f17b921654e19812a9d4c55e760bb'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:08.723356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:08.755061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 987/1943] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:08 2022] DELETE /identity/v3/users/204f17b921654e19812a9d4c55e760bb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:08.756215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.758510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.809804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b092db-a5f0-4158-a95e-1e0f19acbece admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.867898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6e0ae-93c8-41dd-a48d-d41360029b75 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.882612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465903c1-1719-4200-8e5b-54809bd196c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.883248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465903c1-1719-4200-8e5b-54809bd196c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.883529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465903c1-1719-4200-8e5b-54809bd196c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.883804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465903c1-1719-4200-8e5b-54809bd196c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.884455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465903c1-1719-4200-8e5b-54809bd196c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.886284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465903c1-1719-4200-8e5b-54809bd196c7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.887822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:08.901459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.902323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.902697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.903035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.905234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.907395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 988/1944] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:08.912117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.914453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.914864 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.922145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:08.927341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:08.941721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:08.943349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.950654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 957/1945] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:08.951506 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.956911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 989/1946] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:08.966277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:08.967899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.987787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee38a2-3481-4ca8-8800-a1624d870b7d service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.991679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb0501-0b9a-4bc2-a721-956564dc0850 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:08.994677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d39b2-f605-4bc5-93cb-972712dcb111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:08.995503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d39b2-f605-4bc5-93cb-972712dcb111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.996002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d39b2-f605-4bc5-93cb-972712dcb111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.996407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d39b2-f605-4bc5-93cb-972712dcb111 admin admin] PATH_INFO: `/v3/projects/7662f85b054242ab8a9ba197ccabfa22/users/38650d61776545b3b6fdfd5a3002693b/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.000618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:09.001205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.001489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.001808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.015499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d39b2-f605-4bc5-93cb-972712dcb111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7662f85b054242ab8a9ba197ccabfa22, user_id=38650d61776545b3b6fdfd5a3002693b, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:09.020355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d39b2-f605-4bc5-93cb-972712dcb111 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:09.027366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:09.030278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:09.050350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 958/1947] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:08 2022] PUT /identity/v3/projects/7662f85b054242ab8a9ba197ccabfa22/users/38650d61776545b3b6fdfd5a3002693b/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:09.073119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6b9d-5cfa-4780-89f7-3c76209c8304 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.073119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6b9d-5cfa-4780-89f7-3c76209c8304 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.073119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6b9d-5cfa-4780-89f7-3c76209c8304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.073471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 990/1948] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:09.106305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-22ee6b9d-5cfa-4780-89f7-3c76209c8304 None None] MFA Rules not processed for user `38650d61776545b3b6fdfd5a3002693b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:09.107775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-22ee6b9d-5cfa-4780-89f7-3c76209c8304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:09.205916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 959/1949] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:09.212572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:09.224777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232e6c-23e1-468a-a813-d69135ef9515 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:09.310201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:09.310818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.311096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.311439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.312212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:09.314868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:09.360334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 991/1950] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:09 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:09.361271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6b9d-5cfa-4780-89f7-3c76209c8304 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:09.384979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6b9d-5cfa-4780-89f7-3c76209c8304 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:09.398635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:09.403223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:09.453307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:09.489314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:09.490411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.490915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.491520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.492370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:09.494685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:09.528898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528a19-7a17-4983-8ca8-1bc02eb18ab6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:09.533890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 960/1951] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:09 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:09.533890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:09.538641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:09.539610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.540406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.540726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] PATH_INFO: `/v3/projects/55679cee4374470d97b5adc37dc0ff85` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.542237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:09.542593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55679cee4374470d97b5adc37dc0ff85)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:09.546221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:09.605259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b35f-cb44-4042-a249-42c19af7c807 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:09.624307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:09.624903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.626961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.627245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] PATH_INFO: `/v3/users/775c8b550191432dba8f25ad35143e43` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.630318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=775c8b550191432dba8f25ad35143e43)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:09.634822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:09.646117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55679cee4374470d97b5adc37dc0ff85', 'request_id': 'req-baae28de-e260-4ea8-9f80-65e8eb2b03a1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.658619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55679cee4374470d97b5adc37dc0ff85', 'request_id': 'req-baae28de-e260-4ea8-9f80-65e8eb2b03a1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.662883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:09.668423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55679cee4374470d97b5adc37dc0ff85', 'request_id': 'req-baae28de-e260-4ea8-9f80-65e8eb2b03a1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.696738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] The token cache is being invalidate because project 55679cee4374470d97b5adc37dc0ff85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:09.697085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.697902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.699677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 992/1952] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:09 2022] DELETE /identity/v3/projects/55679cee4374470d97b5adc37dc0ff85 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:09.702313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:09.704893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:09.706754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775c8b550191432dba8f25ad35143e43'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.708182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775c8b550191432dba8f25ad35143e43'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.722440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775c8b550191432dba8f25ad35143e43'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.733706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775c8b550191432dba8f25ad35143e43'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.734716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-3be9a843-24ee-499e-badc-6c07604047fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775c8b550191432dba8f25ad35143e43'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:09.764857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 961/1953] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:09 2022] DELETE /identity/v3/users/775c8b550191432dba8f25ad35143e43 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:09.766572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dd858-646f-4e78-a840-e239e8a4f67c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.767180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dd858-646f-4e78-a840-e239e8a4f67c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.767356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dd858-646f-4e78-a840-e239e8a4f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.796497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-532dd858-646f-4e78-a840-e239e8a4f67c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:09.798609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-532dd858-646f-4e78-a840-e239e8a4f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:09.811524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae28de-e260-4ea8-9f80-65e8eb2b03a1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:09.906801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 962/1954] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:09.906895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7cbcc-21cd-4b6d-992a-65cc61fb9f42 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.907185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7cbcc-21cd-4b6d-992a-65cc61fb9f42 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.907463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7cbcc-21cd-4b6d-992a-65cc61fb9f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.908167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac471a1-0d12-4290-ad1c-9cd93860bf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:09.908776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac471a1-0d12-4290-ad1c-9cd93860bf7c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.909047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac471a1-0d12-4290-ad1c-9cd93860bf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.909398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac471a1-0d12-4290-ad1c-9cd93860bf7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.911050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac471a1-0d12-4290-ad1c-9cd93860bf7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:09.912974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac471a1-0d12-4290-ad1c-9cd93860bf7c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:09.924908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 993/1955] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:09.926957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.927236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.928852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.940141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-66a7cbcc-21cd-4b6d-992a-65cc61fb9f42 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:09.942831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-66a7cbcc-21cd-4b6d-992a-65cc61fb9f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:09.950970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 963/1956] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:09.959179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:09.959477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:09.959738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:09.987174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:09.987174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:09.995830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] MFA Rules not processed for user `26a8808b5c5b41da9fd5667084441c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:09.997263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:10.008515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 964/1957] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:10.010367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.013953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:10.037136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251cd1-d7a8-4907-82a4-532f79bb0b10 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.054589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.055283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.055553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.055977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] PATH_INFO: `/v3/projects/e9c7602d00f34ee8890b7d70440788be/users/708dfe739c5d4cfb90121733c3dc1fc8/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.098426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c7602d00f34ee8890b7d70440788be, user_id=708dfe739c5d4cfb90121733c3dc1fc8, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.101159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.109005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:10.127405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 994/1958] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:10.129193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.131770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:10.134981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 965/1959] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:10 2022] PUT /identity/v3/projects/e9c7602d00f34ee8890b7d70440788be/users/708dfe739c5d4cfb90121733c3dc1fc8/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:10.138292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.174748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:10.252217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976028b3-98df-4bb3-af9b-c574f888b098 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.256912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143619-bcc2-4dd9-ad34-6c2ecf032f8c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.258120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.260431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.260737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.260994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.266298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:10.266798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.270643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.292881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 966/1960] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:10.297531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.300344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:10.316005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dedbb-8379-4b7d-9b6b-db011bf85f0b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.321789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.322600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.322953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.323388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.324094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.326464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.339255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.340178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.340602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.341204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.362825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.366244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.369366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 967/1961] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:10 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:10.370669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.383032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 995/1962] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:10.383873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.407130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690e217-8fbb-4055-8228-b3f3bf7d5d3c service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.462674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9dee-2cf7-4a84-8609-49ee2846372f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.469743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.470438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.470774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.471222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.472652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.475870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.491165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 968/1963] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:10.492208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.506933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39916e4-a079-4dbc-a35e-6dbc5058f373 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.515298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.516162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.516439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.516709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.516989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.517341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.517679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.518003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.518295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.518982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.519334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.523545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.551780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 969/1964] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:10 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:10.553022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.558865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 996/1965] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:10 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:10.559866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.564719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f3a0-05c1-465b-9f31-ed1e9f95dbf8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.631529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:10.652147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578af97-8671-4eb9-ae26-dd41258a3b89 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.658800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.659426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.659713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.660435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.661376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.663378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.669481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.670603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.671026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.671439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] PATH_INFO: `/v3/projects/e9c7602d00f34ee8890b7d70440788be/users/708dfe739c5d4cfb90121733c3dc1fc8/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.674353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c7602d00f34ee8890b7d70440788be, user_id=708dfe739c5d4cfb90121733c3dc1fc8, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.677714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.679252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 997/1966] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:10.680106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.687381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:10.692929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef62c-00b7-4edb-8ea5-83218ecf526f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.698515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2f7e7-822c-4838-a273-f1ad31daa900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.699533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2f7e7-822c-4838-a273-f1ad31daa900 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.699931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2f7e7-822c-4838-a273-f1ad31daa900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.700205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2f7e7-822c-4838-a273-f1ad31daa900 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.701182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2f7e7-822c-4838-a273-f1ad31daa900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.705823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2f7e7-822c-4838-a273-f1ad31daa900 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.711882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 970/1967] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:10 2022] PUT /identity/v3/projects/e9c7602d00f34ee8890b7d70440788be/users/708dfe739c5d4cfb90121733c3dc1fc8/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:10.713291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.744406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 998/1968] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:10 2022] POST /identity/v3/users => generated 286 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:10.746079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa621e-9eea-45a7-a0df-23c663236cb2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.746541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa621e-9eea-45a7-a0df-23c663236cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.746953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa621e-9eea-45a7-a0df-23c663236cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.786990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-04fa621e-9eea-45a7-a0df-23c663236cb2 None None] MFA Rules not processed for user `708dfe739c5d4cfb90121733c3dc1fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:10.788517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-04fa621e-9eea-45a7-a0df-23c663236cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:10.841905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832a192-a1a3-4984-a39f-7c2fedec773a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.848971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:10.849852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:10.850274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:10.850799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] PATH_INFO: `/v3/projects/53f232b5a9db4374adaecc5de1ac321b/users/1a919b34ff7b4d46b21ab4893ab7db81/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:10.876384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f232b5a9db4374adaecc5de1ac321b, user_id=1a919b34ff7b4d46b21ab4893ab7db81, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:10.882521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:10.907358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 999/1969] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:10.908466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa621e-9eea-45a7-a0df-23c663236cb2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.913202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 971/1970] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:10 2022] PUT /identity/v3/projects/53f232b5a9db4374adaecc5de1ac321b/users/1a919b34ff7b4d46b21ab4893ab7db81/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:10.914058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:10.916227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:10.933850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa621e-9eea-45a7-a0df-23c663236cb2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:10.997886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846763cd-8b1d-47af-90e4-becc4f3e9076 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.002389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.003287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.003674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.004725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.005292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.005697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.006499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.006892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.007164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] PATH_INFO: `/v3/projects/4c20db5a6f874bc3a283ae4e7351bbd7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.007473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.008809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c20db5a6f874bc3a283ae4e7351bbd7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.010816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.023516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1000/1971] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:11.024548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.041739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579aa09-155a-4b09-8e10-8a992bb5c15f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.060486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.061156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.061538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.061764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.062458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.064127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.085731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1001/1972] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:11.088061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.089370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c20db5a6f874bc3a283ae4e7351bbd7', 'request_id': 'req-47316be1-3aae-4ede-96f5-d43be5ee7455'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.093990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.107600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c20db5a6f874bc3a283ae4e7351bbd7', 'request_id': 'req-47316be1-3aae-4ede-96f5-d43be5ee7455'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.117075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c20db5a6f874bc3a283ae4e7351bbd7', 'request_id': 'req-47316be1-3aae-4ede-96f5-d43be5ee7455'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.118803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:11.135961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] The token cache is being invalidate because project 4c20db5a6f874bc3a283ae4e7351bbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:11.136355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.137186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.143343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 972/1973] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:10 2022] DELETE /identity/v3/projects/4c20db5a6f874bc3a283ae4e7351bbd7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:11.143343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.143837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.199819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea25c5b-184e-4df2-a758-45c04168792a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.215132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:11.260557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316be1-3aae-4ede-96f5-d43be5ee7455 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.267080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.268795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.269148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.269677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.271185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.275888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.276492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.276916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.277186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.277780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.282041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.289493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 973/1974] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:11.290953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.293059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.306973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb496a-18bb-4027-adb8-5bec1d79eb99 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.311900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.312622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.312986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.313325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] PATH_INFO: `/v3/projects/53f232b5a9db4374adaecc5de1ac321b/users/1a919b34ff7b4d46b21ab4893ab7db81/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.315363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f232b5a9db4374adaecc5de1ac321b, user_id=1a919b34ff7b4d46b21ab4893ab7db81, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.318542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.331148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 974/1975] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:11 2022] PUT /identity/v3/projects/53f232b5a9db4374adaecc5de1ac321b/users/1a919b34ff7b4d46b21ab4893ab7db81/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:11.331936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.333934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.371871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.373607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.392614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1002/1976] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:11.420054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.438930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bfc39-8a23-47e9-9e6d-f6213ad79e77 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.447786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.448445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.449113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.449113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] PATH_INFO: `/v3/users/fd29ec1e812a4e3bbbfa5025ed09ab90` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.450666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd29ec1e812a4e3bbbfa5025ed09ab90)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.452476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.474316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902f6d6-68c0-4803-a854-e7bd38013240 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.492117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a23e8-6c32-46f5-87a5-e7399c79bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.494093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a23e8-6c32-46f5-87a5-e7399c79bd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.494775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a23e8-6c32-46f5-87a5-e7399c79bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.497496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a23e8-6c32-46f5-87a5-e7399c79bd08 admin admin] PATH_INFO: `/v3/projects/e111424afc69485d82e7fcb4263474c2/users/0a2b3421e332458fa39e38d09b5226b4/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.516539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd29ec1e812a4e3bbbfa5025ed09ab90'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.517298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd29ec1e812a4e3bbbfa5025ed09ab90'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.541317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a23e8-6c32-46f5-87a5-e7399c79bd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e111424afc69485d82e7fcb4263474c2, user_id=0a2b3421e332458fa39e38d09b5226b4, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.543216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd29ec1e812a4e3bbbfa5025ed09ab90'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.545836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a23e8-6c32-46f5-87a5-e7399c79bd08 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.554507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd29ec1e812a4e3bbbfa5025ed09ab90'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.555704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd29ec1e812a4e3bbbfa5025ed09ab90'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:11.572733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:11.581601 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1003/1977] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:11 2022] PUT /identity/v3/projects/e111424afc69485d82e7fcb4263474c2/users/0a2b3421e332458fa39e38d09b5226b4/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:11.595606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8053c-a639-4b98-a0b1-9a8696e2c838 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.596471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8053c-a639-4b98-a0b1-9a8696e2c838 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.596471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8053c-a639-4b98-a0b1-9a8696e2c838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.603886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 975/1978] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:11 2022] DELETE /identity/v3/users/fd29ec1e812a4e3bbbfa5025ed09ab90 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:11.635017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a4a8053c-a639-4b98-a0b1-9a8696e2c838 None None] MFA Rules not processed for user `0a2b3421e332458fa39e38d09b5226b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:11.636346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a4a8053c-a639-4b98-a0b1-9a8696e2c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.730381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1004/1979] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:11.735817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.737037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.845685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f925ede-ccaa-421b-b608-2c812967d58e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.852158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.852671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.852956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.853224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.853927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.868747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.916618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 976/1980] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:11 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:11.918392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8053c-a639-4b98-a0b1-9a8696e2c838 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.951503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8053c-a639-4b98-a0b1-9a8696e2c838 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:12.042051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:12.106976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:12.109597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.109982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.110624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.112647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:12.115888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:12.179017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1005/1981] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:11 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:12.180643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:12.198456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c418a1-e876-4ebb-b070-39cede289bb3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:12.211128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:12.212382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.212731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.213684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.214439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:12.216109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:12.229307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 977/1982] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:12.233381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:12.249033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0920b58-4a97-4d2f-a904-062948d0732d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:12.258570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:12.260757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.261395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.261826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] PATH_INFO: `/v3/projects/af2be45dd38d463e8bef9b0730d1caa9/users/019add5848e040128398c7be2c2faff9/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.284559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2be45dd38d463e8bef9b0730d1caa9, user_id=019add5848e040128398c7be2c2faff9, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:12.288111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:12.310831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:12.314157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:12.324429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1006/1983] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:12 2022] PUT /identity/v3/projects/af2be45dd38d463e8bef9b0730d1caa9/users/019add5848e040128398c7be2c2faff9/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:12.328524 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:12.339225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e779f-b98c-4164-8845-65c44609f45b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:12.472697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:12.473340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.473650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.473923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] PATH_INFO: `/v3/projects/f765c8cc27f74caaa49850b27b1aaedc` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.475060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f765c8cc27f74caaa49850b27b1aaedc)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:12.479969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:12.482440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8ea7-7045-4616-9d78-ab8ef3a9c824 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:12.491562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:12.492420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.492986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.493404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.494223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:12.497170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:12.514855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1007/1984] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:12.519262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:12.533537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8da66-720c-4bfd-b42e-8555c2826706 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:12.550604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88423b6c-b53a-4945-bbce-b2bdd17705b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:12.552171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88423b6c-b53a-4945-bbce-b2bdd17705b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.568228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88423b6c-b53a-4945-bbce-b2bdd17705b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.568730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88423b6c-b53a-4945-bbce-b2bdd17705b8 admin admin] PATH_INFO: `/v3/projects/af2be45dd38d463e8bef9b0730d1caa9/users/019add5848e040128398c7be2c2faff9/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.575598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88423b6c-b53a-4945-bbce-b2bdd17705b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2be45dd38d463e8bef9b0730d1caa9, user_id=019add5848e040128398c7be2c2faff9, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:12.578882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88423b6c-b53a-4945-bbce-b2bdd17705b8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:12.585392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f765c8cc27f74caaa49850b27b1aaedc', 'request_id': 'req-53369e7c-a790-4264-b36a-4ca612d72ca4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:12.596177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f765c8cc27f74caaa49850b27b1aaedc', 'request_id': 'req-53369e7c-a790-4264-b36a-4ca612d72ca4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:12.602539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1008/1985] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:12 2022] PUT /identity/v3/projects/af2be45dd38d463e8bef9b0730d1caa9/users/019add5848e040128398c7be2c2faff9/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:12.605646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f765c8cc27f74caaa49850b27b1aaedc', 'request_id': 'req-53369e7c-a790-4264-b36a-4ca612d72ca4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:12.622437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5e77-764b-4d61-b944-203382c5f05e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.622437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5e77-764b-4d61-b944-203382c5f05e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.622437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e5e77-764b-4d61-b944-203382c5f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.630417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:12.641065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] The token cache is being invalidate because project f765c8cc27f74caaa49850b27b1aaedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:12.641792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:12.643315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53369e7c-a790-4264-b36a-4ca612d72ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:12.645202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 978/1986] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:12 2022] DELETE /identity/v3/projects/f765c8cc27f74caaa49850b27b1aaedc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:12.650068 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.650885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.651430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.676305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ef0e5e77-764b-4d61-b944-203382c5f05e None None] MFA Rules not processed for user `019add5848e040128398c7be2c2faff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:12.679213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ef0e5e77-764b-4d61-b944-203382c5f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:12.690564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:12.692600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:12.803368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1009/1987] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:12.804687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b468f-3108-4a54-a1cf-56ea2657b75c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.804973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b468f-3108-4a54-a1cf-56ea2657b75c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.805244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b468f-3108-4a54-a1cf-56ea2657b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.822095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:12.830087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 979/1988] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:12.831046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:12.833052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:12.848103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c50b468f-3108-4a54-a1cf-56ea2657b75c None None] MFA Rules not processed for user `1a919b34ff7b4d46b21ab4893ab7db81`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:12.849096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c50b468f-3108-4a54-a1cf-56ea2657b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:12.937874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1010/1989] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:12.939164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c343ac-b585-48ca-9090-d6ee64aa062f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.939452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c343ac-b585-48ca-9090-d6ee64aa062f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.939783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c343ac-b585-48ca-9090-d6ee64aa062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:12.963517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-48c343ac-b585-48ca-9090-d6ee64aa062f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:12.965723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-48c343ac-b585-48ca-9090-d6ee64aa062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:12.977955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1011/1990] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:12.979407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4eae-94b4-4366-8d12-b497da5d392d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:12.979696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4eae-94b4-4366-8d12-b497da5d392d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:12.980057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4eae-94b4-4366-8d12-b497da5d392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.002548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498375d-f8af-4de8-bbc7-465741ea82e9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.004481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-78cc4eae-94b4-4366-8d12-b497da5d392d None None] MFA Rules not processed for user `26a8808b5c5b41da9fd5667084441c87`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:13.006513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-78cc4eae-94b4-4366-8d12-b497da5d392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:13.014519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.015169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.015452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.015721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.020385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:13.091850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1012/1991] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:13.097353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4eae-94b4-4366-8d12-b497da5d392d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.102659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.105196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.111148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4eae-94b4-4366-8d12-b497da5d392d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.116811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 980/1992] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:13.118023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.119299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:13.127013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.127663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.127950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.128224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.128957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:13.129208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.131034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.148964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1013/1993] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:13.150027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.162065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bda328-14f7-4ab5-8c23-f3b72d0a90ef admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.168148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.168892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.169185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.169444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.170121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.172117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.198281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:13.221945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be294ca8-28fb-4591-9ced-4810c572a796 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.228212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1014/1994] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:13 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:13.228433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.229062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.229341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.229665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.231443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:13.232093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.243203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.244886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.255609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 981/1995] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:13.310435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:13.320015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075f35-bc63-45b1-a195-042b6a3b46bd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.326719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.328219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.328676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.328964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.330082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.341427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.396796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1015/1996] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:13 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:13.402679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.424064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0cde-1a38-45d9-bb02-a7b51ca6c1ac service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.436943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.437660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.437939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.438214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.439014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.441037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.469773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 982/1997] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:13.474244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.491204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f17848-cd98-4af8-a356-6aee9ca953ce admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.500052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cbd9e-6fe5-475e-ab8e-6f3c03627a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.500819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cbd9e-6fe5-475e-ab8e-6f3c03627a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.501093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cbd9e-6fe5-475e-ab8e-6f3c03627a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.501365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cbd9e-6fe5-475e-ab8e-6f3c03627a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.502047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cbd9e-6fe5-475e-ab8e-6f3c03627a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.507640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cbd9e-6fe5-475e-ab8e-6f3c03627a21 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.532093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1016/1998] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:13.535233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.554238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c667-4f04-4a42-84d8-c4fbcb9deb71 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.568914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.568914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.568914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.568914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] PATH_INFO: `/v3/projects/12def39f76a343d48ddf293333b9fad4/users/ce3bbbc99cbb4db4b18f991f7b56315f/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.625011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12def39f76a343d48ddf293333b9fad4, user_id=ce3bbbc99cbb4db4b18f991f7b56315f, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.627748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.660396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 983/1999] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:13 2022] PUT /identity/v3/projects/12def39f76a343d48ddf293333b9fad4/users/ce3bbbc99cbb4db4b18f991f7b56315f/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:13.671479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6dcb-87e8-447a-8f75-58b8076c05ed None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.671983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6dcb-87e8-447a-8f75-58b8076c05ed None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.674292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6dcb-87e8-447a-8f75-58b8076c05ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.734287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4fae6dcb-87e8-447a-8f75-58b8076c05ed None None] MFA Rules not processed for user `ce3bbbc99cbb4db4b18f991f7b56315f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:13.735594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4fae6dcb-87e8-447a-8f75-58b8076c05ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:13.841932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1017/2000] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:13.846238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.931320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bfe0c-430f-43c4-9973-859fb2642406 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:13.935929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:13.936531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:13.936802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:13.937070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:13.937854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:13.939730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:13.970993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 984/2001] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:13 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:13.972176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6dcb-87e8-447a-8f75-58b8076c05ed None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:13.983136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6dcb-87e8-447a-8f75-58b8076c05ed None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:14.045148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:14.045802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.046085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.046359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.046978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:14.048910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:14.079033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1018/2002] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:13 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:14.080241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:14.092998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e635-be0d-41fc-8b69-fdedf275a11f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:14.098774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:14.099380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.100239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.100239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.100980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:14.102346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:14.113814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 985/2003] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:14.118096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:14.128127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79d2e0-d0dd-4cdd-b93d-87d81d16fa7d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:14.134119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:14.134836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.135142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.135415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] PATH_INFO: `/v3/projects/3c5ac07a848d4e81a6904198dd6d4374/users/7b284806740640fdb603d9880287bb7e/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.153210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5ac07a848d4e81a6904198dd6d4374, user_id=7b284806740640fdb603d9880287bb7e, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:14.155916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:14.173591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1019/2004] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:14 2022] PUT /identity/v3/projects/3c5ac07a848d4e81a6904198dd6d4374/users/7b284806740640fdb603d9880287bb7e/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:14.177352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:14.188365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c91e0f-6867-4707-8038-1ccb98cff309 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:14.260499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a5471-695e-4bc9-a9cd-d2ab964a4ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:14.261151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5471-695e-4bc9-a9cd-d2ab964a4ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.261391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5471-695e-4bc9-a9cd-d2ab964a4ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.261695 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a5471-695e-4bc9-a9cd-d2ab964a4ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.262530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a5471-695e-4bc9-a9cd-d2ab964a4ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:14.265056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a5471-695e-4bc9-a9cd-d2ab964a4ccb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:14.278116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 986/2005] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:14.281417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:14.295202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2997e-bd54-4d03-89d2-ec2c15716c1e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:14.301597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:14.302449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.302815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.303290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] PATH_INFO: `/v3/projects/3c5ac07a848d4e81a6904198dd6d4374/users/7b284806740640fdb603d9880287bb7e/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.305468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5ac07a848d4e81a6904198dd6d4374, user_id=7b284806740640fdb603d9880287bb7e, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:14.308526 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:14.328582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1020/2006] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:14 2022] PUT /identity/v3/projects/3c5ac07a848d4e81a6904198dd6d4374/users/7b284806740640fdb603d9880287bb7e/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:14.338878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817548-3b54-4afc-b71d-a9e993e2f19a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.339283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817548-3b54-4afc-b71d-a9e993e2f19a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.340489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9817548-3b54-4afc-b71d-a9e993e2f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.383229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f9817548-3b54-4afc-b71d-a9e993e2f19a None None] MFA Rules not processed for user `7b284806740640fdb603d9880287bb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:14.384551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f9817548-3b54-4afc-b71d-a9e993e2f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:14.388906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:14.497173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 987/2007] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:14.512507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:14.556046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:14.667227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133962b5-e0b0-4ef7-bc7d-b61470fc7526 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:14.679245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4cbe0-bd38-43e8-8387-7ef48258dc2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:14.679865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4cbe0-bd38-43e8-8387-7ef48258dc2c service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.680140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4cbe0-bd38-43e8-8387-7ef48258dc2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.680410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4cbe0-bd38-43e8-8387-7ef48258dc2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.704901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4cbe0-bd38-43e8-8387-7ef48258dc2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:14.707689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4cbe0-bd38-43e8-8387-7ef48258dc2c service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:14.751743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1021/2008] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:14.790638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817548-3b54-4afc-b71d-a9e993e2f19a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:14.936267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9817548-3b54-4afc-b71d-a9e993e2f19a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:14.942755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:14.943832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:14.944141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:14.944525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] PATH_INFO: `/v3/users/ce3bbbc99cbb4db4b18f991f7b56315f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:14.946156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3bbbc99cbb4db4b18f991f7b56315f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:14.948802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:15.034091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3bbbc99cbb4db4b18f991f7b56315f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.035131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3bbbc99cbb4db4b18f991f7b56315f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.046773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3bbbc99cbb4db4b18f991f7b56315f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.063846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3bbbc99cbb4db4b18f991f7b56315f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.065568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3bbbc99cbb4db4b18f991f7b56315f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.096990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 988/2009] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:14 2022] DELETE /identity/v3/users/ce3bbbc99cbb4db4b18f991f7b56315f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:15.101393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:15.101723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:15.101994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:15.125840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:15.127080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:15.199440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1022/2010] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:15.210314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:15.212394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:15.234748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:15.335500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe623120-aa20-4042-be8b-edb04393cf58 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:15.346997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:15.347676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:15.347949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:15.348215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:15.377123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:15.378641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:15.399663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 989/2011] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:15.776632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:15.778640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:15.796001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b286-5b44-46a1-8e64-81d8aeacad64 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:15.801315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:15.802002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:15.802274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:15.802555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] PATH_INFO: `/v3/projects/12def39f76a343d48ddf293333b9fad4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:15.803701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12def39f76a343d48ddf293333b9fad4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:15.805734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:15.856782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12def39f76a343d48ddf293333b9fad4', 'request_id': 'req-299dcc69-1549-448e-96bd-b527c0072bcc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.862613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12def39f76a343d48ddf293333b9fad4', 'request_id': 'req-299dcc69-1549-448e-96bd-b527c0072bcc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.871540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12def39f76a343d48ddf293333b9fad4', 'request_id': 'req-299dcc69-1549-448e-96bd-b527c0072bcc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.883965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] The token cache is being invalidate because project 12def39f76a343d48ddf293333b9fad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:15.884429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.885094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:15.886653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1023/2012] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:15 2022] DELETE /identity/v3/projects/12def39f76a343d48ddf293333b9fad4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:15.890621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:15.900396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc8cd6-6cd4-4319-b5c5-5ca3db332696 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:15.962040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:15.962668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:15.962943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:15.963221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] PATH_INFO: `/v3/users/7b284806740640fdb603d9880287bb7e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:15.964358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b284806740640fdb603d9880287bb7e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:15.966320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:16.011831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b284806740640fdb603d9880287bb7e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.012471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b284806740640fdb603d9880287bb7e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.020782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b284806740640fdb603d9880287bb7e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.028353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b284806740640fdb603d9880287bb7e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.028966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c343d199-655e-4ee1-bfa7-1b7227c37c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b284806740640fdb603d9880287bb7e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.048123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 990/2013] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:15 2022] DELETE /identity/v3/users/7b284806740640fdb603d9880287bb7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:16.146597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:16.154583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:16.187495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dcc69-1549-448e-96bd-b527c0072bcc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:16.244518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:16.286187 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:16.286890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:16.287343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:16.287744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] PATH_INFO: `/v3/users/0a2b3421e332458fa39e38d09b5226b4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:16.288935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2b3421e332458fa39e38d09b5226b4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:16.292374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:16.360664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2b3421e332458fa39e38d09b5226b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.362827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2b3421e332458fa39e38d09b5226b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.388157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2b3421e332458fa39e38d09b5226b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.398051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2b3421e332458fa39e38d09b5226b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.398797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2b3421e332458fa39e38d09b5226b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:16.425492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1024/2014] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:16 2022] DELETE /identity/v3/users/0a2b3421e332458fa39e38d09b5226b4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:16.426966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:16.427463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:16.427553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:16.475868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:16.476650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:16.493471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:16.495540 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:16.538091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:16.570587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450d402-f91e-4fea-a6f0-7656df7f352d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:16.575013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:16.576171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:16.576171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:16.576171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:16.576455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 991/2015] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:16.587847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:16.588535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:16.590221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:16.671228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f54c9-277e-4aaf-a2a8-981094fd0bc3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:16.675793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd16efe-9d2c-4bab-91e9-fde82ab83fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:16.676601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd16efe-9d2c-4bab-91e9-fde82ab83fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:16.677590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd16efe-9d2c-4bab-91e9-fde82ab83fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:16.678043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd16efe-9d2c-4bab-91e9-fde82ab83fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:16.682470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:16.684022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:16.690637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd16efe-9d2c-4bab-91e9-fde82ab83fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:16.693368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd16efe-9d2c-4bab-91e9-fde82ab83fb4 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:16.697055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1025/2016] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:16.706772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 992/2017] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:16.944875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:16.947629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:16.974420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70f0e-d395-4c24-abe7-c48577da2020 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.002489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.003139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.003460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.003894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] PATH_INFO: `/v3/projects/3c5ac07a848d4e81a6904198dd6d4374` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.006262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5ac07a848d4e81a6904198dd6d4374)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.009437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.020444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:17.103537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5ac07a848d4e81a6904198dd6d4374', 'request_id': 'req-8fd50dbf-d1e5-48d8-be1f-92c46f127962'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:17.112482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5ac07a848d4e81a6904198dd6d4374', 'request_id': 'req-8fd50dbf-d1e5-48d8-be1f-92c46f127962'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:17.134083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5ac07a848d4e81a6904198dd6d4374', 'request_id': 'req-8fd50dbf-d1e5-48d8-be1f-92c46f127962'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:17.156874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] The token cache is being invalidate because project 3c5ac07a848d4e81a6904198dd6d4374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:17.157056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:17.157748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8fd50dbf-d1e5-48d8-be1f-92c46f127962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:17.162631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1026/2018] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:16 2022] DELETE /identity/v3/projects/3c5ac07a848d4e81a6904198dd6d4374 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:17.164213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8abd-0650-484f-902d-7d1a9d9a365d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.164503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8abd-0650-484f-902d-7d1a9d9a365d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.164782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8abd-0650-484f-902d-7d1a9d9a365d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.189990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-941a8abd-0650-484f-902d-7d1a9d9a365d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:17.192732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-941a8abd-0650-484f-902d-7d1a9d9a365d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:17.296265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 993/2019] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:17.298293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa2add-160c-4d9a-bf89-e7cd4344619e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.298754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa2add-160c-4d9a-bf89-e7cd4344619e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.299092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa2add-160c-4d9a-bf89-e7cd4344619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.319346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0afa2add-160c-4d9a-bf89-e7cd4344619e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:17.320536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0afa2add-160c-4d9a-bf89-e7cd4344619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:17.328498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1027/2020] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:17.332588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8abd-0650-484f-902d-7d1a9d9a365d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.344245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8abd-0650-484f-902d-7d1a9d9a365d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.347061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.348193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.348467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.348733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.349370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:17.349690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.351267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.364350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 994/2021] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:17.368564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa2add-160c-4d9a-bf89-e7cd4344619e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.377976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa2add-160c-4d9a-bf89-e7cd4344619e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.382708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.383307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.383584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.383853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.384490 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.386633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.416941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1028/2022] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:17 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:17.421173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.431908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb939ee-e686-48c9-9192-7a35461754cc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.489984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.490689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.491074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.491347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.491991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.493969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.515820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 995/2023] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:17 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:17.520093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.530564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e3bb-c296-4ffd-95e6-1046f5bab7a0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.535763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.536751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.537249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.537729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.538763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.540677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.552765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1029/2024] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:17.556875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.562254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:17.568838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0bc1-f1eb-4815-8619-2617c190f0c8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.574526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51ab7b-4424-4f3c-b6df-5974516135e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.575263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51ab7b-4424-4f3c-b6df-5974516135e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.575548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51ab7b-4424-4f3c-b6df-5974516135e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.575844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51ab7b-4424-4f3c-b6df-5974516135e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.576498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51ab7b-4424-4f3c-b6df-5974516135e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.578430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51ab7b-4424-4f3c-b6df-5974516135e1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.594631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 996/2025] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:17.595452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.606883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099906-6ec6-4364-b98c-5a2a176b609a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.612003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.612673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.613008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.614224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] PATH_INFO: `/v3/projects/a84bd55135704f9bb6c0da9a0cd53c79/users/4fb6225c4c50491eb467d51ca60cce00/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.631827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a84bd55135704f9bb6c0da9a0cd53c79, user_id=4fb6225c4c50491eb467d51ca60cce00, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.634512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.650027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1030/2026] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:17 2022] PUT /identity/v3/projects/a84bd55135704f9bb6c0da9a0cd53c79/users/4fb6225c4c50491eb467d51ca60cce00/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:17.662133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d59a3-dab8-422f-b71b-b3047aa4f6f8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.662400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d59a3-dab8-422f-b71b-b3047aa4f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.662719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d59a3-dab8-422f-b71b-b3047aa4f6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.695995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-095d59a3-dab8-422f-b71b-b3047aa4f6f8 None None] MFA Rules not processed for user `4fb6225c4c50491eb467d51ca60cce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:17.697486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-095d59a3-dab8-422f-b71b-b3047aa4f6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:17.713295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.718099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:17.798705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 997/2027] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:17.804903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d59a3-dab8-422f-b71b-b3047aa4f6f8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:17.866866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a12692-e2e9-4adc-a56a-4625702fdcf5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.872333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.873332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.876292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.876715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] PATH_INFO: `/v3/projects/e111424afc69485d82e7fcb4263474c2` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.885017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e111424afc69485d82e7fcb4263474c2)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.890509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.953034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d59a3-dab8-422f-b71b-b3047aa4f6f8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:17.965213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:17.969181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:17.969842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:17.970114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:17.970377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:17.971006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:17.973104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:17.987600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e111424afc69485d82e7fcb4263474c2', 'request_id': 'req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:17.994098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e111424afc69485d82e7fcb4263474c2', 'request_id': 'req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.004751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e111424afc69485d82e7fcb4263474c2', 'request_id': 'req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.013542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 998/2028] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:17 2022] POST /identity/v3/projects => generated 409 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:18.018343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] The token cache is being invalidate because project e111424afc69485d82e7fcb4263474c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:18.018555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:18.018760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.019634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.021571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1031/2029] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:17 2022] DELETE /identity/v3/projects/e111424afc69485d82e7fcb4263474c2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:18.026089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:18.027677 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:18.102850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b16205-189e-48d0-bdb7-50111b9f5a40 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:18.107928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:18.108611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.108956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.109288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.110184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:18.112164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:18.114428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62250f-7ec0-4f5b-b8d8-b367e3191b12 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:18.121172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:18.121926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.122641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.123210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] PATH_INFO: `/v3/users/019add5848e040128398c7be2c2faff9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.125053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019add5848e040128398c7be2c2faff9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:18.127864 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:18.133833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:18.154696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 999/2030] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:18 2022] POST /identity/v3/users => generated 311 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:18.159256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:18.169604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:18.185671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f212-2429-49ed-be82-74c2d4934775 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:18.191604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:18.192562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.193009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.193372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.194226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:18.196121 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:18.212705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1000/2031] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:18.213722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:18.224006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019add5848e040128398c7be2c2faff9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.225267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019add5848e040128398c7be2c2faff9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.226876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68974141-d0c8-42e1-8b21-b1fa3a31c8e7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:18.233785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:18.237262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.237634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.238155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] PATH_INFO: `/v3/projects/ef20d052e41c47d596e79f97e3d52edb/users/48b44dbea75c462487c32fb635e848b6/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.247994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019add5848e040128398c7be2c2faff9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.274438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef20d052e41c47d596e79f97e3d52edb, user_id=48b44dbea75c462487c32fb635e848b6, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:18.282927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:18.288231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019add5848e040128398c7be2c2faff9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.289036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019add5848e040128398c7be2c2faff9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:18.325718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1032/2032] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:18 2022] DELETE /identity/v3/users/019add5848e040128398c7be2c2faff9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:18.327772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1001/2033] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:18 2022] PUT /identity/v3/projects/ef20d052e41c47d596e79f97e3d52edb/users/48b44dbea75c462487c32fb635e848b6/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:18.333809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:18.335228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:18.423816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:18.453381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73962f0-21d5-4847-9445-2fbd98b0ede0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:18.461844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2b82a-3ca8-4fb7-b694-792326c7a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:18.462773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2b82a-3ca8-4fb7-b694-792326c7a4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.463665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2b82a-3ca8-4fb7-b694-792326c7a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.463665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2b82a-3ca8-4fb7-b694-792326c7a4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.464011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2b82a-3ca8-4fb7-b694-792326c7a4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:18.467333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2b82a-3ca8-4fb7-b694-792326c7a4d5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:18.486091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1033/2034] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:18.486340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:18.574891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98076c08-f590-438d-a101-26bfe1f66e96 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:18.580201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:18.580900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.581179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.581448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] PATH_INFO: `/v3/projects/ef20d052e41c47d596e79f97e3d52edb/users/48b44dbea75c462487c32fb635e848b6/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.584927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef20d052e41c47d596e79f97e3d52edb, user_id=48b44dbea75c462487c32fb635e848b6, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:18.588128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:18.602289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1002/2035] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:18 2022] PUT /identity/v3/projects/ef20d052e41c47d596e79f97e3d52edb/users/48b44dbea75c462487c32fb635e848b6/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:18.616105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.616373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.616654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.648933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] MFA Rules not processed for user `48b44dbea75c462487c32fb635e848b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:18.650197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:18.729331 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1034/2036] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:18 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:18.740369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:18.742769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:18.812289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd09ff-5738-48af-b63e-e0db32be47e2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:18.816201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:18.817337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:18.817641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:18.817908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:18.827786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:18.829366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:18.840791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1003/2037] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:18 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:19.141798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:19.143279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:19.167742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be98df6-2f43-44a8-829d-11bc3ee7e690 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:19.178117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eefa9-f1ee-4a01-b302-6feabdb6f424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:19.178860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eefa9-f1ee-4a01-b302-6feabdb6f424 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:19.179214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eefa9-f1ee-4a01-b302-6feabdb6f424 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:19.179558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eefa9-f1ee-4a01-b302-6feabdb6f424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:19.181495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4d3eefa9-f1ee-4a01-b302-6feabdb6f424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:19.230905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:19.232285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:19.272008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eefa9-f1ee-4a01-b302-6feabdb6f424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:19.273557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eefa9-f1ee-4a01-b302-6feabdb6f424 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:19.285667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1035/2038] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:19 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:19.308040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:19.315746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda463b8-53a7-4822-9b1e-37390c5a88e2 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:19.323793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:19.325039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:19.325469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:19.325915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] PATH_INFO: `/v3/projects/af2be45dd38d463e8bef9b0730d1caa9` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:19.327352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2be45dd38d463e8bef9b0730d1caa9)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:19.329734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:19.435211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2be45dd38d463e8bef9b0730d1caa9', 'request_id': 'req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:19.455968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2be45dd38d463e8bef9b0730d1caa9', 'request_id': 'req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:19.467190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2be45dd38d463e8bef9b0730d1caa9', 'request_id': 'req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:19.493909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] The token cache is being invalidate because project af2be45dd38d463e8bef9b0730d1caa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:19.494870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:19.495908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a580fd8b-ef0a-4fc4-8226-33a4805e3fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:19.498759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1004/2039] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:19 2022] DELETE /identity/v3/projects/af2be45dd38d463e8bef9b0730d1caa9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:19.506174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb828d-25ae-44eb-a7fa-e67b97b4d5ec None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:19.507123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb828d-25ae-44eb-a7fa-e67b97b4d5ec None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:19.507666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb828d-25ae-44eb-a7fa-e67b97b4d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:19.536836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c7eb828d-25ae-44eb-a7fa-e67b97b4d5ec None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:19.539031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c7eb828d-25ae-44eb-a7fa-e67b97b4d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:19.651711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:19.664494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1036/2040] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:19.673071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec873-f8a6-4b59-9ae9-45b73ee9a31d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:19.673593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec873-f8a6-4b59-9ae9-45b73ee9a31d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:19.674064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec873-f8a6-4b59-9ae9-45b73ee9a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:19.741177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8a6ec873-f8a6-4b59-9ae9-45b73ee9a31d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:19.743481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8a6ec873-f8a6-4b59-9ae9-45b73ee9a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:19.817641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1005/2041] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:19.818561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb828d-25ae-44eb-a7fa-e67b97b4d5ec None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:19.840927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb828d-25ae-44eb-a7fa-e67b97b4d5ec None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:19.856441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:19.858601 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:19.858878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:19.860030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:19.864501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:19.864881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:19.870244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:19.911421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1037/2042] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:19.912408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec873-f8a6-4b59-9ae9-45b73ee9a31d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:19.926374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec873-f8a6-4b59-9ae9-45b73ee9a31d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:19.932496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:19.933445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:19.933993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:19.934463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:19.937061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:19.939479 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:19.987036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1006/2043] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:19 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:19.988669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:20.006646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5083b-2863-4b4c-b78d-c24c37906c1d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:20.149622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:20.162044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:20.162369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:20.162604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:20.163286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:20.165237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:20.210695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1038/2044] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:19 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:20.214546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:20.227397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f431-1b07-44d2-8c3f-acff869f2d9d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:20.243118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:20.243767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:20.244116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:20.244396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:20.248629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:20.248629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:20.270874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1007/2045] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:20.274302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:20.298468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf09409-b8b1-4886-b5dc-3d5a78ec11fd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:20.310471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f255977-9c89-4616-8bed-1b35571d9a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:20.311358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255977-9c89-4616-8bed-1b35571d9a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:20.311783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255977-9c89-4616-8bed-1b35571d9a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:20.312228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f255977-9c89-4616-8bed-1b35571d9a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:20.313018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f255977-9c89-4616-8bed-1b35571d9a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:20.320635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f255977-9c89-4616-8bed-1b35571d9a62 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:20.355979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1039/2046] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:20.360785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:20.383346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5b39a-15f3-4cd2-9ea6-1f39d62ba68f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:20.413429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:20.414465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:20.414959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:20.415414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] PATH_INFO: `/v3/projects/9d39a9cfc655462f9066fe8a91e48770/users/93f4a62842344699a96b8298b665ca7a/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:20.455106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d39a9cfc655462f9066fe8a91e48770, user_id=93f4a62842344699a96b8298b665ca7a, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:20.461071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:20.493223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1008/2047] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:20 2022] PUT /identity/v3/projects/9d39a9cfc655462f9066fe8a91e48770/users/93f4a62842344699a96b8298b665ca7a/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:20.505654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:20.505947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:20.506527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:20.549931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] MFA Rules not processed for user `93f4a62842344699a96b8298b665ca7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:20.550689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:20.636996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1040/2048] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:20.653416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:20.656321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:20.845677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1857d-e573-4ebc-90c7-f37176de51d1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:20.860189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6b125-ff73-489b-a7df-742eeb0e9c28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa77ec9b56cd4027b22fbe0d7ff3ee1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:20.860814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6b125-ff73-489b-a7df-742eeb0e9c28 service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:20.861086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6b125-ff73-489b-a7df-742eeb0e9c28 service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:20.861353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6b125-ff73-489b-a7df-742eeb0e9c28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:20.873109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6b125-ff73-489b-a7df-742eeb0e9c28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:20.875578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6b125-ff73-489b-a7df-742eeb0e9c28 service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:20.889682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1009/2049] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:22.327944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:22.329397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:22.418287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:22.424842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b2ea-c27f-4489-b852-9a65e0443c8c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:22.436208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:22.436958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.437374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.437689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] PATH_INFO: `/v3/users/38650d61776545b3b6fdfd5a3002693b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.438899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38650d61776545b3b6fdfd5a3002693b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.441076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.524468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38650d61776545b3b6fdfd5a3002693b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:22.527498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38650d61776545b3b6fdfd5a3002693b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:22.569634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38650d61776545b3b6fdfd5a3002693b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:22.604710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38650d61776545b3b6fdfd5a3002693b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:22.607680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38650d61776545b3b6fdfd5a3002693b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:22.642822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1041/2050] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:22 2022] DELETE /identity/v3/users/38650d61776545b3b6fdfd5a3002693b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:22.649928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.650439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.650519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.667498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:22.673800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:22.676390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:22.809981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1010/2051] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:22.830398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:22.832377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:22.954466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e58e0-1ef7-4af3-bbeb-fd2eb5ded63b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:22.959156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:22.959774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.960279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.960566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.982758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.984901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.997446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1042/2052] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:24.194686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:24.196261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:24.211706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4040d87-e472-4e08-b021-a23dd5696d30 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:24.216589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:24.217342 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:24.217718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:24.218058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] PATH_INFO: `/v3/projects/7662f85b054242ab8a9ba197ccabfa22` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:24.219246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7662f85b054242ab8a9ba197ccabfa22)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:24.223226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:24.302990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7662f85b054242ab8a9ba197ccabfa22', 'request_id': 'req-20beaf2d-a380-446d-8d95-4d1ba3ef019e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.312317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7662f85b054242ab8a9ba197ccabfa22', 'request_id': 'req-20beaf2d-a380-446d-8d95-4d1ba3ef019e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.319711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7662f85b054242ab8a9ba197ccabfa22', 'request_id': 'req-20beaf2d-a380-446d-8d95-4d1ba3ef019e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.345012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] The token cache is being invalidate because project 7662f85b054242ab8a9ba197ccabfa22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:24.345305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.346364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.349595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1011/2053] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:24 2022] DELETE /identity/v3/projects/7662f85b054242ab8a9ba197ccabfa22 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:24.352569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:24.363941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19fd7e-0174-48a3-8e4c-d1ac6f40f9b6 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:24.455264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:24.455922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:24.456256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:24.456789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] PATH_INFO: `/v3/users/708dfe739c5d4cfb90121733c3dc1fc8` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:24.458514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=708dfe739c5d4cfb90121733c3dc1fc8)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:24.476150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:24.495907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:24.537653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708dfe739c5d4cfb90121733c3dc1fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.539250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708dfe739c5d4cfb90121733c3dc1fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.552818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708dfe739c5d4cfb90121733c3dc1fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.559775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708dfe739c5d4cfb90121733c3dc1fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.560473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-115de71d-c3d9-4a0e-b10f-bededb2fcd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708dfe739c5d4cfb90121733c3dc1fc8'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:24.591221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1043/2054] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:24 2022] DELETE /identity/v3/users/708dfe739c5d4cfb90121733c3dc1fc8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:24.950267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:24.951868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:24.967320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beaf2d-a380-446d-8d95-4d1ba3ef019e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.027739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.028287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.028583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.028848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] PATH_INFO: `/v3/projects/e9c7602d00f34ee8890b7d70440788be` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.032660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c7602d00f34ee8890b7d70440788be)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.032660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.067799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:25.082042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c7602d00f34ee8890b7d70440788be', 'request_id': 'req-bde6e6b4-df14-4fad-ad86-90dcea169470'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.089130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c7602d00f34ee8890b7d70440788be', 'request_id': 'req-bde6e6b4-df14-4fad-ad86-90dcea169470'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.094824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c7602d00f34ee8890b7d70440788be', 'request_id': 'req-bde6e6b4-df14-4fad-ad86-90dcea169470'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.106851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] The token cache is being invalidate because project e9c7602d00f34ee8890b7d70440788be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:25.107140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.107794 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bde6e6b4-df14-4fad-ad86-90dcea169470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.110142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1012/2055] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:24 2022] DELETE /identity/v3/projects/e9c7602d00f34ee8890b7d70440788be => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:25.115722 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb795b-6eb8-4451-9d20-85ab431d5486 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.116001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb795b-6eb8-4451-9d20-85ab431d5486 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.116266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb795b-6eb8-4451-9d20-85ab431d5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.135453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-26eb795b-6eb8-4451-9d20-85ab431d5486 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:25.136630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-26eb795b-6eb8-4451-9d20-85ab431d5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.210116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1044/2056] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:25.220313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116c99-f379-4752-927c-d78b1dbfc306 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.220865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116c99-f379-4752-927c-d78b1dbfc306 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.220865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00116c99-f379-4752-927c-d78b1dbfc306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.241686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-00116c99-f379-4752-927c-d78b1dbfc306 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:25.242877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-00116c99-f379-4752-927c-d78b1dbfc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.250983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1013/2057] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:25.255389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb795b-6eb8-4451-9d20-85ab431d5486 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.265085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb795b-6eb8-4451-9d20-85ab431d5486 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.270553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.271147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.271503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.271679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.272328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:25.272623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.274239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.287584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1045/2058] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:17:25.291994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116c99-f379-4752-927c-d78b1dbfc306 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.303093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00116c99-f379-4752-927c-d78b1dbfc306 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.308144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.308756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.309027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.309298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.309975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.311864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.340218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1014/2059] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:25 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:25.344299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.350311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.352035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.354950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23293bd0-dfe7-478f-8962-2f4870207c96 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.422359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa034e-b592-4b3c-bf54-61d01ee33397 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.426532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.427055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.427195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.427396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.427665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.427752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.427942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.428211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] PATH_INFO: `/v3/users/4fb6225c4c50491eb467d51ca60cce00` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.428396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.429320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb6225c4c50491eb467d51ca60cce00)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.430359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.431230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.454673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1046/2060] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:25 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:25.460076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.470084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291ded6-2ee4-4bfb-a2da-e93301f94430 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.476205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.477095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.477515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.477950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.478900 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.481971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.488128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb6225c4c50491eb467d51ca60cce00'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.488906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb6225c4c50491eb467d51ca60cce00'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.499003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1047/2061] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:25.499203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb6225c4c50491eb467d51ca60cce00'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.500812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.503238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.507448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb6225c4c50491eb467d51ca60cce00'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.508272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-aea2f9fa-a409-4a72-9876-ae6f9ff33f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb6225c4c50491eb467d51ca60cce00'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:25.512245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:25.525361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b092c-a228-49b9-af3d-1703c633e719 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.532599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.535803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1015/2062] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:25 2022] DELETE /identity/v3/users/4fb6225c4c50491eb467d51ca60cce00 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:25.535929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.535929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.535929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.535929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.536207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.537329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.537902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.538124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.551467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1048/2063] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:25.555829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.561194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:25.563437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.567389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ee527-2b3c-4a4d-99c2-e94b7597626d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.570670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:25.649990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f4495-d1a5-46b1-9e12-e11bdc5068ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.650684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f4495-d1a5-46b1-9e12-e11bdc5068ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.650985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f4495-d1a5-46b1-9e12-e11bdc5068ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.651305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f4495-d1a5-46b1-9e12-e11bdc5068ca admin admin] PATH_INFO: `/v3/projects/0b68792ef3e14876954b01d3bba9db3c/users/2b1e24a589be4ef8a6647ee1a7a21ff4/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.657560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1016/2064] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:25.666593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.668048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.668237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f4495-d1a5-46b1-9e12-e11bdc5068ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b68792ef3e14876954b01d3bba9db3c, user_id=2b1e24a589be4ef8a6647ee1a7a21ff4, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.670992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f4495-d1a5-46b1-9e12-e11bdc5068ca admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.696570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1049/2065] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:25 2022] PUT /identity/v3/projects/0b68792ef3e14876954b01d3bba9db3c/users/2b1e24a589be4ef8a6647ee1a7a21ff4/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:25.700539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.700823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.701096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.729650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] MFA Rules not processed for user `2b1e24a589be4ef8a6647ee1a7a21ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:25.729891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c160-9e1b-4d94-8698-f7427f76823c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.730855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.786409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.787355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.787808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.788242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.804556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1050/2066] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:25.818578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:25.820193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:25.861700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.863890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.877544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1017/2067] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:25.897756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d05d5-c7db-41ce-9eeb-0bc1b46dd5e9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:25.901541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:25.902214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:25.902581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:25.902923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:25.911819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:25.913336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:25.922706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1051/2068] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:26.384231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:26.385710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:26.398649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3b7e4-1fec-4b0d-9dec-3b60942b4b94 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:26.403676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:26.404219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:26.404513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:26.404761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] PATH_INFO: `/v3/projects/a84bd55135704f9bb6c0da9a0cd53c79` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:26.405918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a84bd55135704f9bb6c0da9a0cd53c79)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:26.407843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:26.421218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:26.455148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84bd55135704f9bb6c0da9a0cd53c79', 'request_id': 'req-896f8b12-b9bf-4b9d-baf1-c778686e34dc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.462192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84bd55135704f9bb6c0da9a0cd53c79', 'request_id': 'req-896f8b12-b9bf-4b9d-baf1-c778686e34dc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.468123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84bd55135704f9bb6c0da9a0cd53c79', 'request_id': 'req-896f8b12-b9bf-4b9d-baf1-c778686e34dc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.479539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] The token cache is being invalidate because project a84bd55135704f9bb6c0da9a0cd53c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:26.479821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.480445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.481955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1018/2069] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:26 2022] DELETE /identity/v3/projects/a84bd55135704f9bb6c0da9a0cd53c79 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:26.485972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:26.497560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e7338-3e6c-4471-9366-04c402e4f2c1 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:26.501168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:26.568785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:26.569318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:26.569631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:26.569904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] PATH_INFO: `/v3/users/48b44dbea75c462487c32fb635e848b6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:26.571007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b44dbea75c462487c32fb635e848b6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:26.572889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:26.620930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b44dbea75c462487c32fb635e848b6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.621610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b44dbea75c462487c32fb635e848b6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.637064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b44dbea75c462487c32fb635e848b6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.644857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b44dbea75c462487c32fb635e848b6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.645666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6870a707-eac6-4b1e-ac62-f5dc1ee002d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b44dbea75c462487c32fb635e848b6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:26.659473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1052/2070] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:26 2022] DELETE /identity/v3/users/48b44dbea75c462487c32fb635e848b6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:27.154721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:27.158565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:27.177703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f8b12-b9bf-4b9d-baf1-c778686e34dc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:27.279230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:27.280165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.280514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.280859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] PATH_INFO: `/v3/projects/ef20d052e41c47d596e79f97e3d52edb` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.282098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef20d052e41c47d596e79f97e3d52edb)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:27.284289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:27.359471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef20d052e41c47d596e79f97e3d52edb', 'request_id': 'req-efd0fff5-81e9-41d4-891d-e775d3a7869f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:27.374563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef20d052e41c47d596e79f97e3d52edb', 'request_id': 'req-efd0fff5-81e9-41d4-891d-e775d3a7869f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:27.387498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef20d052e41c47d596e79f97e3d52edb', 'request_id': 'req-efd0fff5-81e9-41d4-891d-e775d3a7869f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:27.430044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] The token cache is being invalidate because project ef20d052e41c47d596e79f97e3d52edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:27.430336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:27.431178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-efd0fff5-81e9-41d4-891d-e775d3a7869f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:27.432769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1019/2071] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:27 2022] DELETE /identity/v3/projects/ef20d052e41c47d596e79f97e3d52edb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:27.440037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6311a-f736-4107-96fd-71504a593f34 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.440319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6311a-f736-4107-96fd-71504a593f34 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.440584 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6311a-f736-4107-96fd-71504a593f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.488914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5ae6311a-f736-4107-96fd-71504a593f34 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:27.491559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5ae6311a-f736-4107-96fd-71504a593f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:27.582115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1053/2072] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:27.590533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c975e-086f-4d63-ab5b-3c752a1c9049 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.591115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c975e-086f-4d63-ab5b-3c752a1c9049 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.591425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c975e-086f-4d63-ab5b-3c752a1c9049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.618765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-303c975e-086f-4d63-ab5b-3c752a1c9049 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:27.619959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-303c975e-086f-4d63-ab5b-3c752a1c9049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:27.628409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1020/2073] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:27.634463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6311a-f736-4107-96fd-71504a593f34 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:27.646733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6311a-f736-4107-96fd-71504a593f34 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:27.652564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:27.653743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.654074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.654380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.655410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:27.655713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:27.657282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:27.672480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1054/2074] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:27.673640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c975e-086f-4d63-ab5b-3c752a1c9049 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:27.683707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c975e-086f-4d63-ab5b-3c752a1c9049 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:27.688454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:27.689047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.689323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.689628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.690266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:27.692808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:27.722279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1021/2075] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:27 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:27.726396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:27.736514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da8b35-4059-4122-8f4b-65c5ecaf7964 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:27.746253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:27.795447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:27.796064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.796336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.796619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.797279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:27.799488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:27.823728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1055/2076] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:27 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:27.828010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:27.834181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:27.841232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4543245-83c9-4d90-9bd2-bf068c4d389b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:27.847962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:27.848631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.848980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.849278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.850086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:27.851764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:27.864325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1022/2077] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:27.866319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:27.876391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e33544-a521-4263-a492-e26e0006c458 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:27.880994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9b8e8-4b39-4143-98f7-d3de4e8d899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:27.881620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9b8e8-4b39-4143-98f7-d3de4e8d899c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.881901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9b8e8-4b39-4143-98f7-d3de4e8d899c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.882173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9b8e8-4b39-4143-98f7-d3de4e8d899c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.882860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9b8e8-4b39-4143-98f7-d3de4e8d899c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:27.884516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9b8e8-4b39-4143-98f7-d3de4e8d899c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:27.895512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1056/2078] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:27.899875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:27.911078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9807d-11cb-402a-a774-210462e19329 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:27.915880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:27.916543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.916912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.917206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] PATH_INFO: `/v3/projects/9bc4b13713114746a7b0951c3b84085c/users/7beccee0c7ec4f0882ba59f6aab6d6ae/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:27.933653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc4b13713114746a7b0951c3b84085c, user_id=7beccee0c7ec4f0882ba59f6aab6d6ae, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:27.936591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:27.951457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1023/2079] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:27 2022] PUT /identity/v3/projects/9bc4b13713114746a7b0951c3b84085c/users/7beccee0c7ec4f0882ba59f6aab6d6ae/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:27.963549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:27.964076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:27.964392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:28.001170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] MFA Rules not processed for user `7beccee0c7ec4f0882ba59f6aab6d6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:28.002498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:28.074157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1057/2080] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:28.090631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:28.092404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:28.163953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3e9b-2af0-4307-b5ce-a9e4201b7d44 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:28.167765 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d54b01-fdd8-455f-b77f-e4b73a5664f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:28.168386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d54b01-fdd8-455f-b77f-e4b73a5664f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:28.168664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d54b01-fdd8-455f-b77f-e4b73a5664f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:28.168934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d54b01-fdd8-455f-b77f-e4b73a5664f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:28.182221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d54b01-fdd8-455f-b77f-e4b73a5664f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:28.183771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d54b01-fdd8-455f-b77f-e4b73a5664f0 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:28.194582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1024/2081] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:31.645035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:31.646735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:31.716735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7e8b-5455-4dac-889c-6bf5037fb228 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:31.721233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:31.721942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:31.722241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:31.722486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] PATH_INFO: `/v3/users/2b1e24a589be4ef8a6647ee1a7a21ff4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:31.726147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1e24a589be4ef8a6647ee1a7a21ff4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:31.728190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:31.758264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:31.804043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1e24a589be4ef8a6647ee1a7a21ff4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:31.804854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1e24a589be4ef8a6647ee1a7a21ff4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:31.823230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1e24a589be4ef8a6647ee1a7a21ff4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:31.837824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1e24a589be4ef8a6647ee1a7a21ff4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:31.838630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1e24a589be4ef8a6647ee1a7a21ff4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:31.866776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1058/2082] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:31 2022] DELETE /identity/v3/users/2b1e24a589be4ef8a6647ee1a7a21ff4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:31.869170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:31.869761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:31.869761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:31.896122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:31.897397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:31.974606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1025/2083] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:31.981464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:31.982957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:32.048358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c2d9f-efa7-4fed-b948-2dc298d8ac3f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:32.053632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883a4f-d28e-44c4-8658-486ffbaf22bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:32.054142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883a4f-d28e-44c4-8658-486ffbaf22bb service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:32.054420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883a4f-d28e-44c4-8658-486ffbaf22bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:32.054698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883a4f-d28e-44c4-8658-486ffbaf22bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:32.067005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883a4f-d28e-44c4-8658-486ffbaf22bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:32.068486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883a4f-d28e-44c4-8658-486ffbaf22bb service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:32.078649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1059/2084] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:32.636377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:32.637915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:32.650809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d4961-1b82-41c3-85ef-164836f5baed None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:32.657810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:32.658909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:32.659388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:32.659519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] PATH_INFO: `/v3/projects/0b68792ef3e14876954b01d3bba9db3c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:32.661602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b68792ef3e14876954b01d3bba9db3c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:32.663818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:32.731693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b68792ef3e14876954b01d3bba9db3c', 'request_id': 'req-f3ce1a9f-4c44-4a12-8416-5471ee37a363'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:32.748618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b68792ef3e14876954b01d3bba9db3c', 'request_id': 'req-f3ce1a9f-4c44-4a12-8416-5471ee37a363'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:32.760510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b68792ef3e14876954b01d3bba9db3c', 'request_id': 'req-f3ce1a9f-4c44-4a12-8416-5471ee37a363'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:32.761967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:32.775781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] The token cache is being invalidate because project 0b68792ef3e14876954b01d3bba9db3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:32.776223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:32.777621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f3ce1a9f-4c44-4a12-8416-5471ee37a363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:32.779190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1026/2085] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:32 2022] DELETE /identity/v3/projects/0b68792ef3e14876954b01d3bba9db3c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:32.785502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490edf21-e0ef-4183-b088-e891da18c37a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:32.786051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490edf21-e0ef-4183-b088-e891da18c37a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:32.786051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490edf21-e0ef-4183-b088-e891da18c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:32.807344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-490edf21-e0ef-4183-b088-e891da18c37a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:32.808546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-490edf21-e0ef-4183-b088-e891da18c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:32.872679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1060/2086] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:32.881684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f270-478f-4c43-a4c4-d106b5906048 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:32.882189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f270-478f-4c43-a4c4-d106b5906048 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:32.882290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f270-478f-4c43-a4c4-d106b5906048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:32.905248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-edb6f270-478f-4c43-a4c4-d106b5906048 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:32.906607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-edb6f270-478f-4c43-a4c4-d106b5906048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:32.916193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1027/2087] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:32.920439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490edf21-e0ef-4183-b088-e891da18c37a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:32.931079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490edf21-e0ef-4183-b088-e891da18c37a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:32.936634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:32.937346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:32.937654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:32.937956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:32.938686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:32.938987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:32.940729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:32.954304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1061/2088] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:32.962099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f270-478f-4c43-a4c4-d106b5906048 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:32.972435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f270-478f-4c43-a4c4-d106b5906048 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:32.977237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:32.977873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:32.978151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:32.978420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:32.979061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:32.981099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.010793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1028/2089] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:32 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:33.015486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.031279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12f07-78f0-4cac-af46-75dbce8bae53 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.066094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:33.103083 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.103768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.104085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.104339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.105033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.107122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.118053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.120310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:33.132747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1062/2090] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:33 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:33.135428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069b3bb-8867-40e9-8d02-1e8d3ce243d5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.136802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.140579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.141203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.141476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.141986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] PATH_INFO: `/v3/users/afdb36a7cf1743bb92e0fdf5e3970b3c` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.143230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdb36a7cf1743bb92e0fdf5e3970b3c)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.145409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.147341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca1c58-ccdc-4ca1-abee-075c03a6ece1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.152194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.152773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.153066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.153314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.153975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.155538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.166961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1063/2091] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:33.171034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.181925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75607736-4cfb-4649-acc2-3d7edf481503 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.186733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.187390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.187671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.187944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.188575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.190171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.197221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdb36a7cf1743bb92e0fdf5e3970b3c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.197920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdb36a7cf1743bb92e0fdf5e3970b3c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.200240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1064/2092] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:33.204354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.206237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:33.206514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdb36a7cf1743bb92e0fdf5e3970b3c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.215671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdb36a7cf1743bb92e0fdf5e3970b3c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.216455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cc5cbeec-589a-4537-8dfe-dd4c2861ddec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdb36a7cf1743bb92e0fdf5e3970b3c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.221598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c61e3-0f15-4447-a48a-c70b7ea63c97 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.226944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405830be-d083-4053-a732-860e20090111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.227600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405830be-d083-4053-a732-860e20090111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.227879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405830be-d083-4053-a732-860e20090111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.228150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405830be-d083-4053-a732-860e20090111 admin admin] PATH_INFO: `/v3/projects/4dcb6609ac1540c9a9278768739269bd/users/1e3b03d066634607bc48a888e1269cef/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.235506 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1029/2093] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:33 2022] DELETE /identity/v3/users/afdb36a7cf1743bb92e0fdf5e3970b3c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:33.244401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405830be-d083-4053-a732-860e20090111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcb6609ac1540c9a9278768739269bd, user_id=1e3b03d066634607bc48a888e1269cef, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.247091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405830be-d083-4053-a732-860e20090111 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.266405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1065/2094] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:33 2022] PUT /identity/v3/projects/4dcb6609ac1540c9a9278768739269bd/users/1e3b03d066634607bc48a888e1269cef/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:33.277254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.277826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.278281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.317703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] MFA Rules not processed for user `1e3b03d066634607bc48a888e1269cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:33.319063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:33.405555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1030/2095] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:33.418767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405830be-d083-4053-a732-860e20090111 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.420799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-405830be-d083-4053-a732-860e20090111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:33.438102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.439629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:33.505441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:33.554723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405830be-d083-4053-a732-860e20090111 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.557033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4340-3b5b-4860-9fb2-fef98a2be062 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.559126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ba7d3-4abb-4d82-85c9-7861a4962b1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa77ec9b56cd4027b22fbe0d7ff3ee1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.559902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ba7d3-4abb-4d82-85c9-7861a4962b1c service glance] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.560507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ba7d3-4abb-4d82-85c9-7861a4962b1c service glance] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.560507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ba7d3-4abb-4d82-85c9-7861a4962b1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.562939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.563741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.564285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.564656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] PATH_INFO: `/v3/projects/6a56bcd05fb340218585909e3dde874e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.566093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a56bcd05fb340218585909e3dde874e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.569756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.573000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ba7d3-4abb-4d82-85c9-7861a4962b1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.574525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ba7d3-4abb-4d82-85c9-7861a4962b1c service glance] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.595515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1066/2096] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:33.643548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a56bcd05fb340218585909e3dde874e', 'request_id': 'req-bbf82803-9402-4011-9052-de8eacf0dd4a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.653101 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a56bcd05fb340218585909e3dde874e', 'request_id': 'req-bbf82803-9402-4011-9052-de8eacf0dd4a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.659703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a56bcd05fb340218585909e3dde874e', 'request_id': 'req-bbf82803-9402-4011-9052-de8eacf0dd4a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.672111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] The token cache is being invalidate because project 6a56bcd05fb340218585909e3dde874e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:33.672401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.673072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bbf82803-9402-4011-9052-de8eacf0dd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:33.674785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1031/2097] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:33 2022] DELETE /identity/v3/projects/6a56bcd05fb340218585909e3dde874e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:33.680319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504cd1-10fc-4ac9-baf9-54eadc5c3b43 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.680686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504cd1-10fc-4ac9-baf9-54eadc5c3b43 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.681175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504cd1-10fc-4ac9-baf9-54eadc5c3b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.702492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-45504cd1-10fc-4ac9-baf9-54eadc5c3b43 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:33.703709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-45504cd1-10fc-4ac9-baf9-54eadc5c3b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:33.769073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1067/2098] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:33.776701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8030e79-a900-4c66-85b4-3254231895b0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.777061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8030e79-a900-4c66-85b4-3254231895b0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.777401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8030e79-a900-4c66-85b4-3254231895b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.812093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a8030e79-a900-4c66-85b4-3254231895b0 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:33.813849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a8030e79-a900-4c66-85b4-3254231895b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:33.830837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1032/2099] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:33.835401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504cd1-10fc-4ac9-baf9-54eadc5c3b43 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.845407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504cd1-10fc-4ac9-baf9-54eadc5c3b43 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.855974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.856761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.857147 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.857288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.858381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:33.858775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.860647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.877231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1068/2100] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:33.883460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8030e79-a900-4c66-85b4-3254231895b0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.896370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8030e79-a900-4c66-85b4-3254231895b0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.902557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.903162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.903437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.903703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.904500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.906923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.955741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1033/2101] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:33 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:33.960360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.969046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:33.974813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc43814-64fa-4041-82a6-76876c0304dd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:34.057895 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:34.058514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:34.058816 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:34.059112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:34.059854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:34.062160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:34.087468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1069/2102] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:33 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:34.091521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:34.103537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cc5c8-c194-40ca-9aa6-b37b812ab809 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:34.108954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:34.109779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:34.110058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:34.110329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:34.110986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:34.112604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:34.126083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1034/2103] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:34.130210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:34.141212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd40da-fa62-44f4-ac9f-919775284523 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:34.146766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89092935-c000-4c0d-807b-d2ad6f90a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:34.147364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89092935-c000-4c0d-807b-d2ad6f90a3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:34.147641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89092935-c000-4c0d-807b-d2ad6f90a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:34.147908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89092935-c000-4c0d-807b-d2ad6f90a3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:34.149661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89092935-c000-4c0d-807b-d2ad6f90a3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:34.151252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89092935-c000-4c0d-807b-d2ad6f90a3a5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:34.165548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1070/2104] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:34.168260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:34.178916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe29739-1956-4111-9dae-f76e22d2ff24 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:34.184090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:34.184856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:34.185270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:34.185696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] PATH_INFO: `/v3/projects/ecd8427213124bd2b4d827f120e8c0e4/users/51ad0858945440c2abe6959f7a177a1b/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:34.203104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd8427213124bd2b4d827f120e8c0e4, user_id=51ad0858945440c2abe6959f7a177a1b, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:34.205783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:34.220125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1035/2105] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:34 2022] PUT /identity/v3/projects/ecd8427213124bd2b4d827f120e8c0e4/users/51ad0858945440c2abe6959f7a177a1b/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:34.230883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d4f5-9659-4eab-8fbc-c561027770fb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:34.231164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d4f5-9659-4eab-8fbc-c561027770fb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:34.231433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425d4f5-9659-4eab-8fbc-c561027770fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:34.259984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7425d4f5-9659-4eab-8fbc-c561027770fb None None] MFA Rules not processed for user `51ad0858945440c2abe6959f7a177a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:34.261197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7425d4f5-9659-4eab-8fbc-c561027770fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:34.336763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1071/2106] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:34.347182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:34.349530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:34.401530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:34.424777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd0ff8-d5db-4d98-aa19-0178f7bdf227 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:34.431285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b718-5cb2-4f84-8809-d51a74915178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:34.431983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b718-5cb2-4f84-8809-d51a74915178 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:34.432285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b718-5cb2-4f84-8809-d51a74915178 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:34.432553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b718-5cb2-4f84-8809-d51a74915178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:34.443378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b718-5cb2-4f84-8809-d51a74915178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:34.444951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b718-5cb2-4f84-8809-d51a74915178 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:34.453691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1036/2107] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:37.401852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425d4f5-9659-4eab-8fbc-c561027770fb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:37.467512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425d4f5-9659-4eab-8fbc-c561027770fb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:37.472038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:37.473349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.473661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.473937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] PATH_INFO: `/v3/users/51ad0858945440c2abe6959f7a177a1b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.475082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ad0858945440c2abe6959f7a177a1b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:37.477027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:37.491655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:37.539569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ad0858945440c2abe6959f7a177a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.540720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ad0858945440c2abe6959f7a177a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.561727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ad0858945440c2abe6959f7a177a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.569618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ad0858945440c2abe6959f7a177a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.570429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ad0858945440c2abe6959f7a177a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.586860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1072/2108] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:37 2022] DELETE /identity/v3/users/51ad0858945440c2abe6959f7a177a1b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:37.591983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.592489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.592650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.612410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:37.613694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:37.684471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1037/2109] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:37.694712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:37.696100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:37.759964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1196-083e-4d97-8ed0-ffac3de15dfd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:37.763790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:37.764388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.764662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.764932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.774764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:37.776347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:37.787675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1073/2110] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:37.850448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:37.852158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:37.915834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f774-84e8-4add-b3f2-5aaeb6ac3374 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:37.919605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeac40-ea66-46ca-816b-ed1484b7a7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:37.920200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeac40-ea66-46ca-816b-ed1484b7a7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.920472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeac40-ea66-46ca-816b-ed1484b7a7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.920737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeac40-ea66-46ca-816b-ed1484b7a7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.922533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fddeac40-ea66-46ca-816b-ed1484b7a7c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:37.995339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeac40-ea66-46ca-816b-ed1484b7a7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:37.996796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeac40-ea66-46ca-816b-ed1484b7a7c3 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.007381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1038/2111] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:38.071088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.072649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:38.088696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cb9d0-f44c-4863-bce7-bc2e1bebe7c5 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.096686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.096686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.096686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.098055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] PATH_INFO: `/v3/projects/ecd8427213124bd2b4d827f120e8c0e4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.100037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd8427213124bd2b4d827f120e8c0e4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.102176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.161227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd8427213124bd2b4d827f120e8c0e4', 'request_id': 'req-53a0c5aa-572a-499f-b647-d0631110e7fe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:38.167342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd8427213124bd2b4d827f120e8c0e4', 'request_id': 'req-53a0c5aa-572a-499f-b647-d0631110e7fe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:38.176701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd8427213124bd2b4d827f120e8c0e4', 'request_id': 'req-53a0c5aa-572a-499f-b647-d0631110e7fe'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:38.188646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] The token cache is being invalidate because project ecd8427213124bd2b4d827f120e8c0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:38.188951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:38.189700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-53a0c5aa-572a-499f-b647-d0631110e7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:38.191790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1074/2112] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:38 2022] DELETE /identity/v3/projects/ecd8427213124bd2b4d827f120e8c0e4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:38.196577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd42a8e-4755-450a-9eeb-565d67c31e15 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.196864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd42a8e-4755-450a-9eeb-565d67c31e15 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.197136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd42a8e-4755-450a-9eeb-565d67c31e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.218242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-abd42a8e-4755-450a-9eeb-565d67c31e15 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:38.219551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-abd42a8e-4755-450a-9eeb-565d67c31e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:38.244798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:38.283032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1039/2113] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:38.291167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827beb-e6e3-4bc3-a4a1-f9e4087d748b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.291472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827beb-e6e3-4bc3-a4a1-f9e4087d748b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.291741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827beb-e6e3-4bc3-a4a1-f9e4087d748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.311743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b0827beb-e6e3-4bc3-a4a1-f9e4087d748b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:38.312966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b0827beb-e6e3-4bc3-a4a1-f9e4087d748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:38.321018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1075/2114] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:38.325148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd42a8e-4755-450a-9eeb-565d67c31e15 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.335131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd42a8e-4755-450a-9eeb-565d67c31e15 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.339736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.340331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.340609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.340876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.341532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:38.341843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.343408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.356062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1040/2115] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:38.360170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827beb-e6e3-4bc3-a4a1-f9e4087d748b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.370120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827beb-e6e3-4bc3-a4a1-f9e4087d748b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.380510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.381277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.381652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.382026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.383479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.385460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.396799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:38.422256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1076/2116] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:38 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:38.423560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.434966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468c553-5ed2-470d-be92-e135eff7a63c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.517123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.517790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.518070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.518349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.518988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.521293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.545222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1041/2117] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:38 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:38.549128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.560340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f6e5f-db21-4fee-bf6f-3ed0ec7d58d4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.570136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.570754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.571031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.571300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.571991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.573894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.607686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1077/2118] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:38.608887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.621574 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0e7b-c92a-4765-9437-8b641f1fea8a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.637384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506fbd0-8286-47b1-935e-29e1d8c9a988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.638482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fbd0-8286-47b1-935e-29e1d8c9a988 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.638727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fbd0-8286-47b1-935e-29e1d8c9a988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.646258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fbd0-8286-47b1-935e-29e1d8c9a988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.646963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506fbd0-8286-47b1-935e-29e1d8c9a988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.648583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506fbd0-8286-47b1-935e-29e1d8c9a988 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.670127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1042/2119] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:38.674334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.684880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7369b-b992-4f68-a985-afb9530db108 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.690814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.691721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.692075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.692442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] PATH_INFO: `/v3/projects/331e436dac4346ddb28919a456cc5348/users/c7575b3a1eb14095ac3bbbd108462ba1/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.710146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331e436dac4346ddb28919a456cc5348, user_id=c7575b3a1eb14095ac3bbbd108462ba1, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.713440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:38.728927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1078/2120] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:38 2022] PUT /identity/v3/projects/331e436dac4346ddb28919a456cc5348/users/c7575b3a1eb14095ac3bbbd108462ba1/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:38.740691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76ca3-2078-4945-978a-635b19234f54 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.740951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76ca3-2078-4945-978a-635b19234f54 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.741221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb76ca3-2078-4945-978a-635b19234f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.823057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0bb76ca3-2078-4945-978a-635b19234f54 None None] MFA Rules not processed for user `c7575b3a1eb14095ac3bbbd108462ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:38.823604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0bb76ca3-2078-4945-978a-635b19234f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:38.902486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1043/2121] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:38.907121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.977859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bc504-1c7c-486e-b3ff-37f25108bd61 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:38.983059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:38.983668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:38.985769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:38.986061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:38.986705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:38.988707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.016257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1079/2122] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:38 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:39.021413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb76ca3-2078-4945-978a-635b19234f54 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:39.040186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb76ca3-2078-4945-978a-635b19234f54 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.060916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:39.100487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.101102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.101381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.101688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.102338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.104218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.129243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1044/2123] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:39 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:39.130450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:39.140576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a4359-bc92-4b2c-ae21-bf53b93e4d4a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.145829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.146425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.146707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.146979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.147612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.149183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.162839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1080/2124] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:39.166965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:39.177163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe10cb-7b45-4873-b4bc-fe4a0a0fed34 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.181882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.182527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.182806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.183081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] PATH_INFO: `/v3/projects/bf1cdb232c2b4be08db4dafe570daa57/users/b39e70a5b11f4c3887ef5e30acecc7a4/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.198141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1cdb232c2b4be08db4dafe570daa57, user_id=b39e70a5b11f4c3887ef5e30acecc7a4, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.200775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.214818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1045/2125] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:39 2022] PUT /identity/v3/projects/bf1cdb232c2b4be08db4dafe570daa57/users/b39e70a5b11f4c3887ef5e30acecc7a4/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:39.218710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:39.229024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8950d-c5ce-4f69-8d9f-04dfce01819b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.285572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9de851-3943-460d-8c1c-b2176f48fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.286090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de851-3943-460d-8c1c-b2176f48fdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.286363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de851-3943-460d-8c1c-b2176f48fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.286629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9de851-3943-460d-8c1c-b2176f48fdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.287259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9de851-3943-460d-8c1c-b2176f48fdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.288811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9de851-3943-460d-8c1c-b2176f48fdf7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.298373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1081/2126] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:39.302521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:39.312755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8f092-3a85-4e9b-b657-501a236612d6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.317808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.318443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.318718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.318988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] PATH_INFO: `/v3/projects/bf1cdb232c2b4be08db4dafe570daa57/users/b39e70a5b11f4c3887ef5e30acecc7a4/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.320872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1cdb232c2b4be08db4dafe570daa57, user_id=b39e70a5b11f4c3887ef5e30acecc7a4, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.323521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.334273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1046/2127] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:39 2022] PUT /identity/v3/projects/bf1cdb232c2b4be08db4dafe570daa57/users/b39e70a5b11f4c3887ef5e30acecc7a4/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:39.344138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e81be-0bc4-4120-8d30-4e33244613fb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.344417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e81be-0bc4-4120-8d30-4e33244613fb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.344712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e81be-0bc4-4120-8d30-4e33244613fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.372002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4d9e81be-0bc4-4120-8d30-4e33244613fb None None] MFA Rules not processed for user `b39e70a5b11f4c3887ef5e30acecc7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:39.373198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4d9e81be-0bc4-4120-8d30-4e33244613fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:39.385795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:39.444347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1082/2128] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:39.456164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:39.458599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:39.520037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5e86-3fff-44e8-9ac2-b89f58d315c5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.523705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203057f-5ccd-4ed4-8ca3-4587de7ca220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.524331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203057f-5ccd-4ed4-8ca3-4587de7ca220 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.524610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203057f-5ccd-4ed4-8ca3-4587de7ca220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.524881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203057f-5ccd-4ed4-8ca3-4587de7ca220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.534346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203057f-5ccd-4ed4-8ca3-4587de7ca220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.535832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203057f-5ccd-4ed4-8ca3-4587de7ca220 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.545777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1047/2129] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:40.011949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e81be-0bc4-4120-8d30-4e33244613fb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:40.086029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e81be-0bc4-4120-8d30-4e33244613fb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:40.091008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:40.091631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:40.091905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:40.092172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] PATH_INFO: `/v3/users/c7575b3a1eb14095ac3bbbd108462ba1` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:40.093285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7575b3a1eb14095ac3bbbd108462ba1)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:40.095202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:40.141294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7575b3a1eb14095ac3bbbd108462ba1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.142031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7575b3a1eb14095ac3bbbd108462ba1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.154302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7575b3a1eb14095ac3bbbd108462ba1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.162043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7575b3a1eb14095ac3bbbd108462ba1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.162741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7575b3a1eb14095ac3bbbd108462ba1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.176246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1083/2130] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:40 2022] DELETE /identity/v3/users/c7575b3a1eb14095ac3bbbd108462ba1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:40.181403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:40.182024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:40.182024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:40.201115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:40.202323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:40.268025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1048/2131] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:40.278520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:40.279929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:40.312799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:40.341314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad87b-521d-4a61-8070-e17ab2bc406f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:40.345060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:40.345787 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:40.346060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:40.346326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:40.356932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:40.358399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:40.369235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1084/2132] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:40.647106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:40.648522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:40.661372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634aba4-54f7-4b65-948c-2ef042075700 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:40.666421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:40.667279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:40.667658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:40.667909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] PATH_INFO: `/v3/projects/331e436dac4346ddb28919a456cc5348` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:40.669159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=331e436dac4346ddb28919a456cc5348)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:40.671881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:40.694823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:40.738259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331e436dac4346ddb28919a456cc5348', 'request_id': 'req-5cb2cc59-fccd-489b-8272-978927f0a1dc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.746259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331e436dac4346ddb28919a456cc5348', 'request_id': 'req-5cb2cc59-fccd-489b-8272-978927f0a1dc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.752569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331e436dac4346ddb28919a456cc5348', 'request_id': 'req-5cb2cc59-fccd-489b-8272-978927f0a1dc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.764338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] The token cache is being invalidate because project 331e436dac4346ddb28919a456cc5348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:40.764623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.765269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.766797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1049/2133] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:40 2022] DELETE /identity/v3/projects/331e436dac4346ddb28919a456cc5348 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:40.771335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:40.780730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643c567-e55d-4bfb-8593-41e724810741 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:40.844486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:40.845115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:40.845405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:40.845688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] PATH_INFO: `/v3/users/b39e70a5b11f4c3887ef5e30acecc7a4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:40.846798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39e70a5b11f4c3887ef5e30acecc7a4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:40.848714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:40.896583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39e70a5b11f4c3887ef5e30acecc7a4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.897290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39e70a5b11f4c3887ef5e30acecc7a4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.909030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39e70a5b11f4c3887ef5e30acecc7a4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.916832 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39e70a5b11f4c3887ef5e30acecc7a4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.917811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-994ab0fc-b7df-4fe7-9116-0c42e077cc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39e70a5b11f4c3887ef5e30acecc7a4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:40.931050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1085/2134] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:40 2022] DELETE /identity/v3/users/b39e70a5b11f4c3887ef5e30acecc7a4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:41.255306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.257243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:41.280780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2cc59-fccd-489b-8272-978927f0a1dc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.354891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.355474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.355751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.356030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] PATH_INFO: `/v3/projects/bf1cdb232c2b4be08db4dafe570daa57` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.358704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1cdb232c2b4be08db4dafe570daa57)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.360721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.415542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1cdb232c2b4be08db4dafe570daa57', 'request_id': 'req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.427892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1cdb232c2b4be08db4dafe570daa57', 'request_id': 'req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.435971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1cdb232c2b4be08db4dafe570daa57', 'request_id': 'req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.449547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] The token cache is being invalidate because project bf1cdb232c2b4be08db4dafe570daa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:41.449547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.450227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-11bc99a6-cae2-48c1-a5d5-bc15b16aa03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.453551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1050/2135] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:41 2022] DELETE /identity/v3/projects/bf1cdb232c2b4be08db4dafe570daa57 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:41.456914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51dd8-557a-4033-b8a7-51aa2073b249 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.457409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51dd8-557a-4033-b8a7-51aa2073b249 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.458175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51dd8-557a-4033-b8a7-51aa2073b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.481039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b5a51dd8-557a-4033-b8a7-51aa2073b249 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:41.482577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b5a51dd8-557a-4033-b8a7-51aa2073b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:41.539402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:41.559139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1086/2136] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:41.570385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19bd1-a4cf-4311-b701-2ceebb27e018 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.570806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19bd1-a4cf-4311-b701-2ceebb27e018 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.571362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19bd1-a4cf-4311-b701-2ceebb27e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.596068 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c0c19bd1-a4cf-4311-b701-2ceebb27e018 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:41.597453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c0c19bd1-a4cf-4311-b701-2ceebb27e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:41.609579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1051/2137] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:41.615748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a51dd8-557a-4033-b8a7-51aa2073b249 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.628425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a51dd8-557a-4033-b8a7-51aa2073b249 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.634614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.635234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.635545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.635845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.636498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:41.636803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.638433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.651534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1087/2138] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:41.656230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19bd1-a4cf-4311-b701-2ceebb27e018 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.670589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19bd1-a4cf-4311-b701-2ceebb27e018 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.675553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.676240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.676584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.677014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.677876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.679851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.711060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1052/2139] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:41.715193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.725740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf79c-e327-4f06-ae43-f506d8c86c9a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.826133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.826981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.827206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.827460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.828345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.830681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.858472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1088/2140] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:41.859652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.872337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:41.876500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dd63e-74d4-4519-ad00-e10379090d6f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.882624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.883362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.883954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.884168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.885026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.887554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.902890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1053/2141] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:41.906853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.919087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5de92-cd2d-48e7-96f5-0a0fc1e622b9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.923964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36356ccd-2ca3-44c6-b423-5906fc6ed61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.924573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356ccd-2ca3-44c6-b423-5906fc6ed61c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.924850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356ccd-2ca3-44c6-b423-5906fc6ed61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.925125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36356ccd-2ca3-44c6-b423-5906fc6ed61c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.926352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356ccd-2ca3-44c6-b423-5906fc6ed61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.928065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36356ccd-2ca3-44c6-b423-5906fc6ed61c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.941971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1089/2142] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:41.946213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.959598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd4af5-a402-4e79-810a-8ae9365fd6a0 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.966994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.967740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.967991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.968278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] PATH_INFO: `/v3/projects/cbfce65f864c4d7e974512beb72cbd35/users/21fa4cca0deb41f0a080082684183deb/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.992443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfce65f864c4d7e974512beb72cbd35, user_id=21fa4cca0deb41f0a080082684183deb, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.995223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.010854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1054/2143] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:41 2022] PUT /identity/v3/projects/cbfce65f864c4d7e974512beb72cbd35/users/21fa4cca0deb41f0a080082684183deb/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:42.021244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ae826-7869-40a9-b120-598690f9a007 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.021786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ae826-7869-40a9-b120-598690f9a007 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.022205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ae826-7869-40a9-b120-598690f9a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.056019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ff2ae826-7869-40a9-b120-598690f9a007 None None] MFA Rules not processed for user `21fa4cca0deb41f0a080082684183deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:42.057241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ff2ae826-7869-40a9-b120-598690f9a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:42.129182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1090/2144] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:42.133661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.202531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00a33a-8ef1-463b-9d69-340a30181946 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.207685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.208591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.208867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.209133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.210008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.212407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.246110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1055/2145] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:42.248342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ae826-7869-40a9-b120-598690f9a007 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.262186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ae826-7869-40a9-b120-598690f9a007 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.322142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:42.341154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.343066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.343512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.343925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.345330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.349897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.386697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1091/2146] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:42.391517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.413041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4dfd-7191-4b1f-af61-92ecfa05b564 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.422486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.423465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.423895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.424341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.425262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.436682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.449805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1056/2147] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:42.454530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.468689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46831eca-37ef-4887-a398-03b58e2049e2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.474505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.475155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.475430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.475737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] PATH_INFO: `/v3/projects/e5b5e467c2844194805c238ada97f03d/users/452e7578f7214fc9aaa47158a80eea52/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.495713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b5e467c2844194805c238ada97f03d, user_id=452e7578f7214fc9aaa47158a80eea52, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.498372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.513276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.515155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:42.515509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1092/2148] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:42 2022] PUT /identity/v3/projects/e5b5e467c2844194805c238ada97f03d/users/452e7578f7214fc9aaa47158a80eea52/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:42.520209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.532755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175bc75-5a1a-4cdc-a438-efc8d368a322 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.608923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.609832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.610214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.610347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a651f8-9d0a-49be-bad2-65a2e2ffd52a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.610666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] PATH_INFO: `/v3/users/7beccee0c7ec4f0882ba59f6aab6d6ae` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.611952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7beccee0c7ec4f0882ba59f6aab6d6ae)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.614046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.616551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.616551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.616551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.616551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.617170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.618794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.629452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1093/2149] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:42.640871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.657974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021b3e-b610-42c3-864d-312174bb9da9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.664256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22319445-da3b-46d9-822d-2895f4d35e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.664946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319445-da3b-46d9-822d-2895f4d35e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.665232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319445-da3b-46d9-822d-2895f4d35e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.665583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319445-da3b-46d9-822d-2895f4d35e64 admin admin] PATH_INFO: `/v3/projects/e5b5e467c2844194805c238ada97f03d/users/452e7578f7214fc9aaa47158a80eea52/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.667608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22319445-da3b-46d9-822d-2895f4d35e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b5e467c2844194805c238ada97f03d, user_id=452e7578f7214fc9aaa47158a80eea52, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.670207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22319445-da3b-46d9-822d-2895f4d35e64 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.681007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1094/2150] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:42 2022] PUT /identity/v3/projects/e5b5e467c2844194805c238ada97f03d/users/452e7578f7214fc9aaa47158a80eea52/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:42.691061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:42.692386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.692566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7beccee0c7ec4f0882ba59f6aab6d6ae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:42.692667 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.692931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.693401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7beccee0c7ec4f0882ba59f6aab6d6ae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:42.702564 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7beccee0c7ec4f0882ba59f6aab6d6ae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:42.714368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7beccee0c7ec4f0882ba59f6aab6d6ae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:42.715249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d0c2c737-c643-457f-a067-62ecc416d4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7beccee0c7ec4f0882ba59f6aab6d6ae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:42.727376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] MFA Rules not processed for user `452e7578f7214fc9aaa47158a80eea52`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:42.728605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:42.739158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1057/2151] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:42 2022] DELETE /identity/v3/users/7beccee0c7ec4f0882ba59f6aab6d6ae => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:42.744455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.744762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.745027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.767418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:42.769202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:42.825716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1095/2152] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:42.840873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.842998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:42.854771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1058/2153] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:42.866313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.867857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:42.875247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:42.921606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a8caf-4253-41da-8764-1e8eea652445 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.936747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a726e-c283-475e-8dc7-66c56fa33a0d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.940468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.941072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.941895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.942165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.952375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.953877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.964714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1059/2154] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:42.983694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.984317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.984600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.984878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.069616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.071498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.085545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1096/2155] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:43.143982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.146597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:43.161831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc645905-1d91-4be0-82e3-fc2ef0c7f10b service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.165407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fa2fa-0677-4909-b8b3-d26277aa00df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.166039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa2fa-0677-4909-b8b3-d26277aa00df service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.166315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa2fa-0677-4909-b8b3-d26277aa00df service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.166586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa2fa-0677-4909-b8b3-d26277aa00df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.168936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-028fa2fa-0677-4909-b8b3-d26277aa00df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:43.235104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fa2fa-0677-4909-b8b3-d26277aa00df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.236538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fa2fa-0677-4909-b8b3-d26277aa00df service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.246021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1060/2156] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:43.269944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.271890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:43.285958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d079ce6-af79-4e1e-84a1-5e18b5d2fdbb service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.290948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.291684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.291966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.292455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] PATH_INFO: `/v3/projects/9bc4b13713114746a7b0951c3b84085c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.294094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc4b13713114746a7b0951c3b84085c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.296290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.351857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc4b13713114746a7b0951c3b84085c', 'request_id': 'req-a62a6089-9125-4607-bad6-cb057d353583'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:43.357589 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc4b13713114746a7b0951c3b84085c', 'request_id': 'req-a62a6089-9125-4607-bad6-cb057d353583'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:43.370133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc4b13713114746a7b0951c3b84085c', 'request_id': 'req-a62a6089-9125-4607-bad6-cb057d353583'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:43.383231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] The token cache is being invalidate because project 9bc4b13713114746a7b0951c3b84085c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:43.383520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:43.384172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a62a6089-9125-4607-bad6-cb057d353583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:43.385702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1097/2157] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:43 2022] DELETE /identity/v3/projects/9bc4b13713114746a7b0951c3b84085c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:43.390873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dae04-a62f-4994-a949-5ee16eda2acf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.391150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dae04-a62f-4994-a949-5ee16eda2acf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.391421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dae04-a62f-4994-a949-5ee16eda2acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.400745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.415331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fa1dae04-a62f-4994-a949-5ee16eda2acf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:43.417121 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fa1dae04-a62f-4994-a949-5ee16eda2acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:43.484996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1061/2158] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:43.492395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218f01-a956-457a-bf70-10cdfbf3b81c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.492868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218f01-a956-457a-bf70-10cdfbf3b81c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.493138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218f01-a956-457a-bf70-10cdfbf3b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.517744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-08218f01-a956-457a-bf70-10cdfbf3b81c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:43.519016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08218f01-a956-457a-bf70-10cdfbf3b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:43.542632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dae04-a62f-4994-a949-5ee16eda2acf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.543222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1098/2159] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:43.553265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dae04-a62f-4994-a949-5ee16eda2acf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.558921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.559559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.559838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.560108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.560757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:43.561059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.562665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.576383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1062/2160] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:43.581247 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08218f01-a956-457a-bf70-10cdfbf3b81c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.592858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08218f01-a956-457a-bf70-10cdfbf3b81c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.594604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.602613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.603293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.603578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.603907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.604546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.606690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.646873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1099/2161] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:43 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:43.650942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.664805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b8f40-ca67-41dc-866d-1120d9446ee4 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.735292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.736004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.736377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.736735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.737450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.740002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.762587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1063/2162] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:43 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:43.766735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.777256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300220c3-a68d-4118-b93f-a2ec46443680 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.782375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.783061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.783307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.783575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.784408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.786662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.797205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1100/2163] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:43.801825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.811805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f100-41e5-4b01-830b-cf35d8ad937c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.816497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a4e1-402f-46bc-b439-1cb9a02f40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.817095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a4e1-402f-46bc-b439-1cb9a02f40e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.817426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a4e1-402f-46bc-b439-1cb9a02f40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.817763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a4e1-402f-46bc-b439-1cb9a02f40e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.818404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a4e1-402f-46bc-b439-1cb9a02f40e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.819986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a4e1-402f-46bc-b439-1cb9a02f40e0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.834372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1064/2164] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:43.835542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.846542 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd661418-78ad-4736-9fad-cfeaf63086c9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.851905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.852574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.852984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.853268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] PATH_INFO: `/v3/projects/b79c67d049644e64b92bd51473b24a51/users/332c7a29288c4c51bf07844795606cbd/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.868889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79c67d049644e64b92bd51473b24a51, user_id=332c7a29288c4c51bf07844795606cbd, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.871771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.885589 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1101/2165] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:43 2022] PUT /identity/v3/projects/b79c67d049644e64b92bd51473b24a51/users/332c7a29288c4c51bf07844795606cbd/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:43.898540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.899660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.900133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.960137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] MFA Rules not processed for user `332c7a29288c4c51bf07844795606cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:43.961541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:44.037639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:44.042621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1065/2166] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:44.053752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:44.055523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:44.113993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92292025-8638-4ab5-9077-64c3f5343221 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:44.117775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fea878-167a-4791-b944-65b28473590b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:44.118423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea878-167a-4791-b944-65b28473590b service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:44.118700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea878-167a-4791-b944-65b28473590b service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:44.118967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fea878-167a-4791-b944-65b28473590b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:44.127295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fea878-167a-4791-b944-65b28473590b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:44.128751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fea878-167a-4791-b944-65b28473590b service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:44.137421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1102/2167] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:46.733388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:46.734796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:46.797800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a0e19-3bea-4f27-b9fb-c6baa9eff7a5 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:46.803536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:46.804157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:46.804428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:46.804693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] PATH_INFO: `/v3/users/21fa4cca0deb41f0a080082684183deb` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:46.805850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21fa4cca0deb41f0a080082684183deb)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:46.807752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:46.858343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21fa4cca0deb41f0a080082684183deb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.859000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21fa4cca0deb41f0a080082684183deb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.867887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21fa4cca0deb41f0a080082684183deb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.876088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21fa4cca0deb41f0a080082684183deb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.876995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21fa4cca0deb41f0a080082684183deb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.900123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1066/2168] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:46 2022] DELETE /identity/v3/users/21fa4cca0deb41f0a080082684183deb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:46.904580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:46.905079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:46.905168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:46.924705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:46.926099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:46.987752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1103/2169] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:46.997414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:46.998869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:47.060050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2aea7-20ad-49ec-a5ef-b367777a238a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:47.063710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:47.064309 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:47.064584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:47.064853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:47.074103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:47.075512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:47.085826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1067/2170] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:47.434729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:47.436152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:47.449900 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0caeff-c61a-4933-beab-49a13e05bbaf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:47.454647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:47.455282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:47.455555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:47.455825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] PATH_INFO: `/v3/projects/cbfce65f864c4d7e974512beb72cbd35` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:47.457686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfce65f864c4d7e974512beb72cbd35)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:47.459827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:47.507717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:47.511666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfce65f864c4d7e974512beb72cbd35', 'request_id': 'req-d36c28d6-f6be-4195-88d3-dcea1ced2acc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.517974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfce65f864c4d7e974512beb72cbd35', 'request_id': 'req-d36c28d6-f6be-4195-88d3-dcea1ced2acc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.525586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfce65f864c4d7e974512beb72cbd35', 'request_id': 'req-d36c28d6-f6be-4195-88d3-dcea1ced2acc'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.536891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] The token cache is being invalidate because project cbfce65f864c4d7e974512beb72cbd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:47.537177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.537829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.539397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1104/2171] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:47 2022] DELETE /identity/v3/projects/cbfce65f864c4d7e974512beb72cbd35 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:47.543495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:47.553194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41230a84-9edc-43a3-96c8-7387f958c6f3 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:47.576498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:47.623433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:47.624068 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:47.624339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:47.624606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] PATH_INFO: `/v3/users/452e7578f7214fc9aaa47158a80eea52` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:47.625741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=452e7578f7214fc9aaa47158a80eea52)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:47.627644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:47.679773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452e7578f7214fc9aaa47158a80eea52'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.680485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452e7578f7214fc9aaa47158a80eea52'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.687768 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452e7578f7214fc9aaa47158a80eea52'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.705720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452e7578f7214fc9aaa47158a80eea52'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.705720 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-d80158a5-f081-4fef-8a7d-d9e1d7a3cd8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452e7578f7214fc9aaa47158a80eea52'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.716355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1068/2172] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:47 2022] DELETE /identity/v3/users/452e7578f7214fc9aaa47158a80eea52 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:48.047989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.051255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:48.072102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c28d6-f6be-4195-88d3-dcea1ced2acc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.134295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.135334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.135617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.135926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] PATH_INFO: `/v3/projects/e5b5e467c2844194805c238ada97f03d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.137203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b5e467c2844194805c238ada97f03d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.139295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.196618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b5e467c2844194805c238ada97f03d', 'request_id': 'req-060dc89c-aeef-4d2e-bf6a-de1109d05199'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.204001 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b5e467c2844194805c238ada97f03d', 'request_id': 'req-060dc89c-aeef-4d2e-bf6a-de1109d05199'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.212203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b5e467c2844194805c238ada97f03d', 'request_id': 'req-060dc89c-aeef-4d2e-bf6a-de1109d05199'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.223172 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] The token cache is being invalidate because project e5b5e467c2844194805c238ada97f03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:48.223452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.224070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-060dc89c-aeef-4d2e-bf6a-de1109d05199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.225568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1105/2173] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:48 2022] DELETE /identity/v3/projects/e5b5e467c2844194805c238ada97f03d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:48.230764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34851-5b4c-4c91-ae11-c4cc0b49413c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.231361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34851-5b4c-4c91-ae11-c4cc0b49413c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.231361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34851-5b4c-4c91-ae11-c4cc0b49413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.251595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-efd34851-5b4c-4c91-ae11-c4cc0b49413c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:48.252871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-efd34851-5b4c-4c91-ae11-c4cc0b49413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:48.314998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1069/2174] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:48.324741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c642167-0f73-44ee-86d1-4dbfa7559661 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.325111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c642167-0f73-44ee-86d1-4dbfa7559661 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.325468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c642167-0f73-44ee-86d1-4dbfa7559661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.348175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5c642167-0f73-44ee-86d1-4dbfa7559661 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:48.349691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5c642167-0f73-44ee-86d1-4dbfa7559661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:48.358361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1106/2175] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:48.362601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd34851-5b4c-4c91-ae11-c4cc0b49413c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.372783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd34851-5b4c-4c91-ae11-c4cc0b49413c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.377405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.378092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.378373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.379184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.379842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:48.380144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.381741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.394982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1070/2176] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:48.399306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c642167-0f73-44ee-86d1-4dbfa7559661 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.409877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c642167-0f73-44ee-86d1-4dbfa7559661 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.414651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.415257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.415534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.415805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.416430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.418337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.446262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1107/2177] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:48.451001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.461644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630b223-3cd5-4370-b9af-e6987b6a3aba admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.486286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:48.521100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.521973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.522443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.523054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.524114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.526142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.550172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1071/2178] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:48.551842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.562455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7a8c5-6b18-416d-bdcb-4a1708e437ee admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.568164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.568906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.569192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.569450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.570199 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.571821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.589565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1108/2179] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:48.593290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.603191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665c24b-ad31-4479-8b46-720e57c252d8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.607739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38452569-22bc-4d03-a590-8b1b988fdaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.608320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452569-22bc-4d03-a590-8b1b988fdaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.608590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452569-22bc-4d03-a590-8b1b988fdaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.608866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38452569-22bc-4d03-a590-8b1b988fdaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.609483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452569-22bc-4d03-a590-8b1b988fdaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.611083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38452569-22bc-4d03-a590-8b1b988fdaa8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.621903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1072/2180] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:48.626085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.637074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d5aa-70e0-4a86-a301-fe42befd311a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.641945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.642619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.642898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.643231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] PATH_INFO: `/v3/projects/2145c95b7294493197a10d2156d324c7/users/3f2f5ce957244344b406fcfb84d70f88/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.658987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2145c95b7294493197a10d2156d324c7, user_id=3f2f5ce957244344b406fcfb84d70f88, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.661860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.669719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:48.677612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1109/2181] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:48 2022] PUT /identity/v3/projects/2145c95b7294493197a10d2156d324c7/users/3f2f5ce957244344b406fcfb84d70f88/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:48.687629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c393-1bbf-4502-821f-9581a8e3015e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.687906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c393-1bbf-4502-821f-9581a8e3015e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.688171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c393-1bbf-4502-821f-9581a8e3015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.716534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4ac4c393-1bbf-4502-821f-9581a8e3015e None None] MFA Rules not processed for user `3f2f5ce957244344b406fcfb84d70f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:48.717782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4ac4c393-1bbf-4502-821f-9581a8e3015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:48.782188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1073/2182] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:48.787218 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.853160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214131-7bc7-4cb2-906b-27b80c182d7d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.859359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.859964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.860242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.860512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.861154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.863745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.890382 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1110/2183] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:48.894476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c393-1bbf-4502-821f-9581a8e3015e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.905499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c393-1bbf-4502-821f-9581a8e3015e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.965978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.966579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.966876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.967144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.967922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.970031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.998041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1074/2184] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/users => generated 307 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:49.002379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.015648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b072d8-44c9-4620-b136-d402d3d9d3dd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.022166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.022966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.023385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.023655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.024575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.026647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.039580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1111/2185] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:49.043602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.061205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d15d8-46a6-4cef-82e3-4c6d4d5d84fe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.066623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.069141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.069617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.069898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] PATH_INFO: `/v3/projects/f1d46ed772af490c9255b67f057eefa3/users/b19891bc86114472aae7efd8396c2626/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.086197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d46ed772af490c9255b67f057eefa3, user_id=b19891bc86114472aae7efd8396c2626, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.088860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.103899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1075/2186] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:49 2022] PUT /identity/v3/projects/f1d46ed772af490c9255b67f057eefa3/users/b19891bc86114472aae7efd8396c2626/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:49.108378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.120004 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e902d7-d23c-497d-999a-e2f76cb2eeb8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.158126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.159967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:49.165156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:49.192050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.192696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.192980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.193246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.194035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.195795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.207572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1112/2187] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:49.211660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.227056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ca99-2958-4e36-bf19-0abf02639f5a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.233961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ef941-17be-4f0f-bc77-001818007c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.234690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ef941-17be-4f0f-bc77-001818007c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.235398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ef941-17be-4f0f-bc77-001818007c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.235680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ef941-17be-4f0f-bc77-001818007c37 admin admin] PATH_INFO: `/v3/projects/f1d46ed772af490c9255b67f057eefa3/users/b19891bc86114472aae7efd8396c2626/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.243205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ef941-17be-4f0f-bc77-001818007c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d46ed772af490c9255b67f057eefa3, user_id=b19891bc86114472aae7efd8396c2626, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.246026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ef941-17be-4f0f-bc77-001818007c37 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.252579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb251d-7218-448e-b8b8-374c024991eb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.258616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.259248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.259524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.259797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] PATH_INFO: `/v3/users/332c7a29288c4c51bf07844795606cbd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.261263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332c7a29288c4c51bf07844795606cbd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.263965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.272986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1113/2188] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:49 2022] PUT /identity/v3/projects/f1d46ed772af490c9255b67f057eefa3/users/b19891bc86114472aae7efd8396c2626/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:49.284094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15e116-3059-4423-b030-96d72133a439 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.284389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15e116-3059-4423-b030-96d72133a439 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.284650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15e116-3059-4423-b030-96d72133a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.335208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3c15e116-3059-4423-b030-96d72133a439 None None] MFA Rules not processed for user `b19891bc86114472aae7efd8396c2626`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:49.336776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3c15e116-3059-4423-b030-96d72133a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:49.353707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332c7a29288c4c51bf07844795606cbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:49.355194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332c7a29288c4c51bf07844795606cbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:49.367623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332c7a29288c4c51bf07844795606cbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:49.384517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332c7a29288c4c51bf07844795606cbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:49.385289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1cb4c7ba-dc58-4f49-b373-e14f4b02a6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332c7a29288c4c51bf07844795606cbd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:49.406654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1076/2189] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:49 2022] DELETE /identity/v3/users/332c7a29288c4c51bf07844795606cbd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:49.407807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:49.412009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66079807-d338-4ac3-a019-304671ca2577 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.412403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66079807-d338-4ac3-a019-304671ca2577 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.412687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66079807-d338-4ac3-a019-304671ca2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.433255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-66079807-d338-4ac3-a019-304671ca2577 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:49.434619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-66079807-d338-4ac3-a019-304671ca2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:49.442477 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1114/2190] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:49 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:49.458373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15e116-3059-4423-b030-96d72133a439 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.458588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3c15e116-3059-4423-b030-96d72133a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:49.527786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1077/2191] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:49.538861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66079807-d338-4ac3-a019-304671ca2577 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.540972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-66079807-d338-4ac3-a019-304671ca2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:49.569960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15e116-3059-4423-b030-96d72133a439 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.578314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:49.623828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66079807-d338-4ac3-a019-304671ca2577 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.629874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.630644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.630982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.631381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.642402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.644062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.659362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1078/2192] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:49.718377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.719611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.719937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.720211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.819636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.821183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.833316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1115/2193] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:49 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:49.928126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.937761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571f61-bb81-49af-898a-acd168d384e7 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.942232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.942820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.943128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.943395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.945109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:49.992710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.994248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:50.011317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93a6d2-8f62-46f2-bc6d-e3824cefa9a6 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:50.016320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:50.017015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:50.017951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:50.018294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] PATH_INFO: `/v3/projects/b79c67d049644e64b92bd51473b24a51` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:50.019617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79c67d049644e64b92bd51473b24a51)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:50.021704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:50.022135 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:50.023418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:50.034193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1079/2194] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:50.068483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:50.081774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79c67d049644e64b92bd51473b24a51', 'request_id': 'req-120d78c2-8ab1-428d-8318-7dfcce957b86'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:50.088206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79c67d049644e64b92bd51473b24a51', 'request_id': 'req-120d78c2-8ab1-428d-8318-7dfcce957b86'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:50.097023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79c67d049644e64b92bd51473b24a51', 'request_id': 'req-120d78c2-8ab1-428d-8318-7dfcce957b86'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:50.112484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] The token cache is being invalidate because project b79c67d049644e64b92bd51473b24a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:50.113616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:50.114137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-120d78c2-8ab1-428d-8318-7dfcce957b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:50.115624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1116/2195] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:49 2022] DELETE /identity/v3/projects/b79c67d049644e64b92bd51473b24a51 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:54.315604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:54.317778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:54.340450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dc1e-6f89-4c1e-a4a5-47b3f976e6a1 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:54.432621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:54.433333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:54.433713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:54.433988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] PATH_INFO: `/v3/users/3f2f5ce957244344b406fcfb84d70f88` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:54.435518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2f5ce957244344b406fcfb84d70f88)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:54.437424 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:54.494327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2f5ce957244344b406fcfb84d70f88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.495113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2f5ce957244344b406fcfb84d70f88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.503222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2f5ce957244344b406fcfb84d70f88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.511235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2f5ce957244344b406fcfb84d70f88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.511898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2f5ce957244344b406fcfb84d70f88'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.514565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:54.535935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1080/2196] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:54 2022] DELETE /identity/v3/users/3f2f5ce957244344b406fcfb84d70f88 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:54.540975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:54.541682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:54.541958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:54.564328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:54.565620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:54.636107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1117/2197] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:54.646924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:54.648281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:54.718239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3751a-37ef-4b4c-8c52-14065bb9571f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:54.721941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:54.722544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:54.722818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:54.723086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:54.732260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:54.733803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:54.743340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1081/2198] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:55.023296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:55.025160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:55.039383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73051fb-7bac-4427-b5fd-4ec864d337d2 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:55.044125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:55.044759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:55.045035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:55.045306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] PATH_INFO: `/v3/projects/2145c95b7294493197a10d2156d324c7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:55.046475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2145c95b7294493197a10d2156d324c7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:55.050077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:55.099276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2145c95b7294493197a10d2156d324c7', 'request_id': 'req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.104686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2145c95b7294493197a10d2156d324c7', 'request_id': 'req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.111964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2145c95b7294493197a10d2156d324c7', 'request_id': 'req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.123710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] The token cache is being invalidate because project 2145c95b7294493197a10d2156d324c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:55.124025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.124782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.126571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1118/2199] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:55 2022] DELETE /identity/v3/projects/2145c95b7294493197a10d2156d324c7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:55.131283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:55.140880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144049-e38b-4761-bdca-b6a8261eab34 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:55.196841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:55.197410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:55.197752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:55.198026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] PATH_INFO: `/v3/users/b19891bc86114472aae7efd8396c2626` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:55.199163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19891bc86114472aae7efd8396c2626)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:55.201064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:55.247140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19891bc86114472aae7efd8396c2626'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.247824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19891bc86114472aae7efd8396c2626'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.255800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19891bc86114472aae7efd8396c2626'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.262575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19891bc86114472aae7efd8396c2626'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.263215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5fa0e223-d008-4649-a972-a7861853b6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19891bc86114472aae7efd8396c2626'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.280143 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1082/2200] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:55 2022] DELETE /identity/v3/users/b19891bc86114472aae7efd8396c2626 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:55.647609 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:55.649637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:55.672197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a9103-ed70-4e48-ae98-d0be87ac5adf admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:55.740378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:55.752611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:55.753272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:55.753577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:55.753855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] PATH_INFO: `/v3/projects/f1d46ed772af490c9255b67f057eefa3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:55.757774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d46ed772af490c9255b67f057eefa3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:55.757774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:55.811210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d46ed772af490c9255b67f057eefa3', 'request_id': 'req-2826df0c-428d-4388-9149-0996d0917cca'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.816972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d46ed772af490c9255b67f057eefa3', 'request_id': 'req-2826df0c-428d-4388-9149-0996d0917cca'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.825048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d46ed772af490c9255b67f057eefa3', 'request_id': 'req-2826df0c-428d-4388-9149-0996d0917cca'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.840061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] The token cache is being invalidate because project f1d46ed772af490c9255b67f057eefa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:55.840345 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.841088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-2826df0c-428d-4388-9149-0996d0917cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.842817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1119/2201] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:55 2022] DELETE /identity/v3/projects/f1d46ed772af490c9255b67f057eefa3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:55.847593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d2fb-c053-4f9f-95fd-2d7abe94bc7b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:55.848049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d2fb-c053-4f9f-95fd-2d7abe94bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:55.848139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450d2fb-c053-4f9f-95fd-2d7abe94bc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:55.857827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:55.872277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c450d2fb-c053-4f9f-95fd-2d7abe94bc7b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:55.874530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c450d2fb-c053-4f9f-95fd-2d7abe94bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:55.970381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1083/2202] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:55.977971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52cf20-09ba-49af-9c09-0747339ea855 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:55.978126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52cf20-09ba-49af-9c09-0747339ea855 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:55.978717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52cf20-09ba-49af-9c09-0747339ea855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.005879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2f52cf20-09ba-49af-9c09-0747339ea855 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:56.007125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2f52cf20-09ba-49af-9c09-0747339ea855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:56.018407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1120/2203] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:56.019795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450d2fb-c053-4f9f-95fd-2d7abe94bc7b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.033542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450d2fb-c053-4f9f-95fd-2d7abe94bc7b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.038798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.039693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.039963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.040229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.040868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:56.041162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.042813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.066234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1084/2204] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:56.068078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52cf20-09ba-49af-9c09-0747339ea855 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.077862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52cf20-09ba-49af-9c09-0747339ea855 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.082446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.083811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.084121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.084470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.084989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.086972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.121921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1121/2205] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:56 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:56.126778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.137931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02529780-424c-4868-bc08-107f9d5a3081 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.214361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.217651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.218028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.218311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.218992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.221051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.243045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1085/2206] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:56 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:56.247395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.261746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4acc-fdae-48d0-9619-2b80ea5b41f9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.267196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.267851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.268132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.268397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.269118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.271529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.285313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1122/2207] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:56.289996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.303561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18daf5-c6ba-4e2c-a8af-a460766e766d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.308507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22387-d746-4450-825a-3a1ebfcbabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.309118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22387-d746-4450-825a-3a1ebfcbabf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.309394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22387-d746-4450-825a-3a1ebfcbabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.309699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22387-d746-4450-825a-3a1ebfcbabf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.310368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22387-d746-4450-825a-3a1ebfcbabf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.311927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22387-d746-4450-825a-3a1ebfcbabf7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.337846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1086/2208] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:56.341853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.351714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60926184-5ce2-4e28-a4af-1b480cc866fa admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.356286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.356917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.357216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.357502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] PATH_INFO: `/v3/projects/14f08e6c2c394a88b7bfd343b72c21e6/users/2cbcb05cc99d4ffcb3b46676177b9fe6/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.371870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f08e6c2c394a88b7bfd343b72c21e6, user_id=2cbcb05cc99d4ffcb3b46676177b9fe6, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.374543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.388523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1123/2209] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:56 2022] PUT /identity/v3/projects/14f08e6c2c394a88b7bfd343b72c21e6/users/2cbcb05cc99d4ffcb3b46676177b9fe6/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:56.399732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cad03-08d6-4ede-a831-4de1320e56b9 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.400062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cad03-08d6-4ede-a831-4de1320e56b9 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.400331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cad03-08d6-4ede-a831-4de1320e56b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.428786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e20cad03-08d6-4ede-a831-4de1320e56b9 None None] MFA Rules not processed for user `2cbcb05cc99d4ffcb3b46676177b9fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:56.430196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e20cad03-08d6-4ede-a831-4de1320e56b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:56.493299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:56.497677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1087/2210] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:56.502113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.563615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c391597-89ea-45c4-964c-6be40ee9eb3e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.569152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.570007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.570289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.570561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.571188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.573066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.601996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1124/2211] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:56 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:56.606147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cad03-08d6-4ede-a831-4de1320e56b9 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.624733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cad03-08d6-4ede-a831-4de1320e56b9 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.683734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.684589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.684862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.685133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.685847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.687878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.711801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1088/2212] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:56 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:56.715759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.722923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:56.727379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a90ae-eeb1-4624-ad50-0e1b208bf803 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.733691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.734371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.734814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.735238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.736072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.737702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.750292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1125/2213] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:56.754617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.765810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af228f-8985-4fc6-8066-3b912fae5136 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.770591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.771261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.771534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.771798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] PATH_INFO: `/v3/projects/2b9279f0c612485fa46846358b824eb9/users/29ec91df8b6b4dbf83afc5552a78161f/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.787360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9279f0c612485fa46846358b824eb9, user_id=29ec91df8b6b4dbf83afc5552a78161f, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.790031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.803528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1089/2214] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:56 2022] PUT /identity/v3/projects/2b9279f0c612485fa46846358b824eb9/users/29ec91df8b6b4dbf83afc5552a78161f/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:56.807367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.817555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881d87d-3d54-4904-b5f2-4617082163ee admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.878312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c962-9e6c-47fe-b382-eb37907d7267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.878838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c962-9e6c-47fe-b382-eb37907d7267 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.879233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c962-9e6c-47fe-b382-eb37907d7267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.879420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c962-9e6c-47fe-b382-eb37907d7267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.880136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c962-9e6c-47fe-b382-eb37907d7267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.882756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c962-9e6c-47fe-b382-eb37907d7267 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.893992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1126/2215] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:56.898224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.908398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b732-cce1-4ae3-a477-616032e91ce8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.912968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.913657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.913928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.914192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] PATH_INFO: `/v3/projects/2b9279f0c612485fa46846358b824eb9/users/29ec91df8b6b4dbf83afc5552a78161f/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.916188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9279f0c612485fa46846358b824eb9, user_id=29ec91df8b6b4dbf83afc5552a78161f, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.918904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.930230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1090/2216] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:56 2022] PUT /identity/v3/projects/2b9279f0c612485fa46846358b824eb9/users/29ec91df8b6b4dbf83afc5552a78161f/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:56.941373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334899e6-08e1-4170-96fa-4852298c3010 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.941715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334899e6-08e1-4170-96fa-4852298c3010 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.942009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334899e6-08e1-4170-96fa-4852298c3010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.971514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-334899e6-08e1-4170-96fa-4852298c3010 None None] MFA Rules not processed for user `29ec91df8b6b4dbf83afc5552a78161f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:56.972746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-334899e6-08e1-4170-96fa-4852298c3010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:57.043898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1127/2217] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:57.055935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.057636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:57.122477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddefde-432d-48a1-aedb-f537b13b36a2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:57.126186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e575de3-07c5-4b50-8c7e-491f776cdeaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:57.126791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e575de3-07c5-4b50-8c7e-491f776cdeaf service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.127067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e575de3-07c5-4b50-8c7e-491f776cdeaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.127371 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e575de3-07c5-4b50-8c7e-491f776cdeaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.137674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e575de3-07c5-4b50-8c7e-491f776cdeaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:57.139103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e575de3-07c5-4b50-8c7e-491f776cdeaf service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.151813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1091/2218] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:57.291557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334899e6-08e1-4170-96fa-4852298c3010 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.370333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334899e6-08e1-4170-96fa-4852298c3010 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:57.378498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:57.378498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.378498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.378498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] PATH_INFO: `/v3/users/2cbcb05cc99d4ffcb3b46676177b9fe6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.378932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbcb05cc99d4ffcb3b46676177b9fe6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:57.381252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.399639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:57.441926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbcb05cc99d4ffcb3b46676177b9fe6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.442650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbcb05cc99d4ffcb3b46676177b9fe6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.461481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbcb05cc99d4ffcb3b46676177b9fe6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.471506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbcb05cc99d4ffcb3b46676177b9fe6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.472308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbcb05cc99d4ffcb3b46676177b9fe6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.494215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1128/2219] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:57 2022] DELETE /identity/v3/users/2cbcb05cc99d4ffcb3b46676177b9fe6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:57.500243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.500569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.500869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.530737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:57.533715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:57.594956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:57.608114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1092/2220] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:57.618450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.620535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:57.691574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b5d14-bb9f-430a-9c2c-951c83725306 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:57.695975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:57.696575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.696852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.697122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.708955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:57.710395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.720051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1129/2221] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:58.013968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.016287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:58.047517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b9ad-3e5e-475c-92e1-d600e3539a34 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:58.053161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:58.053929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.054144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.054452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] PATH_INFO: `/v3/projects/14f08e6c2c394a88b7bfd343b72c21e6` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.055552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f08e6c2c394a88b7bfd343b72c21e6)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:58.057447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:58.106053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f08e6c2c394a88b7bfd343b72c21e6', 'request_id': 'req-620ef9f4-6870-4020-876e-720cbe7665f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.114278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f08e6c2c394a88b7bfd343b72c21e6', 'request_id': 'req-620ef9f4-6870-4020-876e-720cbe7665f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.119813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f08e6c2c394a88b7bfd343b72c21e6', 'request_id': 'req-620ef9f4-6870-4020-876e-720cbe7665f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.130736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] The token cache is being invalidate because project 14f08e6c2c394a88b7bfd343b72c21e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:58.131017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.131634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.133110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1093/2222] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:58 2022] DELETE /identity/v3/projects/14f08e6c2c394a88b7bfd343b72c21e6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:58.137091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.147438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7c3b8-e7ad-4b8d-bf24-f84182c1438c service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:58.204658 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:58.205694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.206021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.206316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] PATH_INFO: `/v3/users/29ec91df8b6b4dbf83afc5552a78161f` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.208114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ec91df8b6b4dbf83afc5552a78161f)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:58.210666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:58.256462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:58.268367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ec91df8b6b4dbf83afc5552a78161f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.269423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ec91df8b6b4dbf83afc5552a78161f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.286472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ec91df8b6b4dbf83afc5552a78161f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.294543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ec91df8b6b4dbf83afc5552a78161f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.295265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b3beeb1-567e-463e-9758-830f1248b544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ec91df8b6b4dbf83afc5552a78161f'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.313887 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1130/2223] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:58 2022] DELETE /identity/v3/users/29ec91df8b6b4dbf83afc5552a78161f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:58.611459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.612996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:58.627429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef9f4-6870-4020-876e-720cbe7665f3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:58.706148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:58.706972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.707367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.707716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] PATH_INFO: `/v3/projects/2b9279f0c612485fa46846358b824eb9` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.709123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9279f0c612485fa46846358b824eb9)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:58.711112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:58.764992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9279f0c612485fa46846358b824eb9', 'request_id': 'req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.786166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9279f0c612485fa46846358b824eb9', 'request_id': 'req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.797542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9279f0c612485fa46846358b824eb9', 'request_id': 'req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.814780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] The token cache is being invalidate because project 2b9279f0c612485fa46846358b824eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:58.815066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.815722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-186767db-78a4-4ac2-bd5e-2afadf9f0ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:58.817225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1094/2224] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:58 2022] DELETE /identity/v3/projects/2b9279f0c612485fa46846358b824eb9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:58.822481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6b01c-d74f-4f06-8af6-0c8c7aa34dc1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.823032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6b01c-d74f-4f06-8af6-0c8c7aa34dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.823190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6b01c-d74f-4f06-8af6-0c8c7aa34dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.843973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-08c6b01c-d74f-4f06-8af6-0c8c7aa34dc1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:58.845192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08c6b01c-d74f-4f06-8af6-0c8c7aa34dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:58.909198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1131/2225] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:58.917623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339966cd-7bc5-4bb0-916b-78888651335c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.917908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339966cd-7bc5-4bb0-916b-78888651335c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.918179 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339966cd-7bc5-4bb0-916b-78888651335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.939756 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-339966cd-7bc5-4bb0-916b-78888651335c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:58.940973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-339966cd-7bc5-4bb0-916b-78888651335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:58.949795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1095/2226] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:58.953922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6b01c-d74f-4f06-8af6-0c8c7aa34dc1 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.964304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6b01c-d74f-4f06-8af6-0c8c7aa34dc1 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:58.969153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:58.969791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.970062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.970328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.970969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:58.971270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:58.972859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:58.985941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1132/2227] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:58.990349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339966cd-7bc5-4bb0-916b-78888651335c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.994812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:59.001277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339966cd-7bc5-4bb0-916b-78888651335c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.007127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.007722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.008025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.008292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.008916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.010861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.041277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1096/2228] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:58 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:59.045375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.058223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b152932-affd-4467-82d0-6e35a900f73a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.123333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.123943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.124225 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.124494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.125130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.127466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.160061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1133/2229] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:59 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:59.161487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.174781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2250d9-b65b-4c89-8669-cd6a5d5e423e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.180627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.181229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.181526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.181796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.182825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.184131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.198909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1097/2230] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:59.201313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.215173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84063d-3ae4-4176-af27-8230bf7c15e0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.231553 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79945d69-1726-4298-a793-a32c31ceaf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.232303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79945d69-1726-4298-a793-a32c31ceaf7a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.232651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79945d69-1726-4298-a793-a32c31ceaf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.232991 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79945d69-1726-4298-a793-a32c31ceaf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.234291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79945d69-1726-4298-a793-a32c31ceaf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.236445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79945d69-1726-4298-a793-a32c31ceaf7a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.252313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1134/2231] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:59.253486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.268190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eddf5-3235-454d-978a-0314c3bd72b3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.275868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.276354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.276679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.276951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] PATH_INFO: `/v3/projects/33fa8472a5654c038d6ea82ed8a2153b/users/46ed5291cafb4e01aabc11a6772eb59d/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.296877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa8472a5654c038d6ea82ed8a2153b, user_id=46ed5291cafb4e01aabc11a6772eb59d, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.299104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.318848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1098/2232] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:59 2022] PUT /identity/v3/projects/33fa8472a5654c038d6ea82ed8a2153b/users/46ed5291cafb4e01aabc11a6772eb59d/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:59.323679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.323966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.324635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.349278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:59.350679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.369882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:59.413615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.415704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.475456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1135/2233] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:59.486565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.490592 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.537269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b7238-be7c-4004-9a7f-e0aa4350d4fb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.547156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.548123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.548475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.548826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] PATH_INFO: `/v3/users/93f4a62842344699a96b8298b665ca7a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.550968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f4a62842344699a96b8298b665ca7a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.554193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.577320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9bee3-fbd1-4a9d-af40-ab481c1b7467 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.582706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb415-7870-451f-a35b-18347773f791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.582706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb415-7870-451f-a35b-18347773f791 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.582706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb415-7870-451f-a35b-18347773f791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.583269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb415-7870-451f-a35b-18347773f791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.596403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb415-7870-451f-a35b-18347773f791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.598567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb415-7870-451f-a35b-18347773f791 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.630739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1136/2234] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:59.644507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f4a62842344699a96b8298b665ca7a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.645434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f4a62842344699a96b8298b665ca7a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.659872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f4a62842344699a96b8298b665ca7a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.674187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f4a62842344699a96b8298b665ca7a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.674752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f4a62842344699a96b8298b665ca7a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.699990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1099/2235] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:59 2022] DELETE /identity/v3/users/93f4a62842344699a96b8298b665ca7a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:59.704819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.705319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.713375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.754282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:59.756282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.852897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1137/2236] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:59.868202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.870091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.906481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:59.980363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09563e5-54f9-4f65-8d4e-c135bde44e32 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.988761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.991096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.991372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.991650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.006510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.009199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:00.031530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1100/2237] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:00.369575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:00.370617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:00.393568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea5203-9303-4512-9465-b45c540bba0a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:00.406015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:00.407064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.407441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.407791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] PATH_INFO: `/v3/users/26a8808b5c5b41da9fd5667084441c87` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.409009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a8808b5c5b41da9fd5667084441c87)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.411137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:00.487949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a8808b5c5b41da9fd5667084441c87'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.488967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a8808b5c5b41da9fd5667084441c87'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.500500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:00.503380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a8808b5c5b41da9fd5667084441c87'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.511438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a8808b5c5b41da9fd5667084441c87'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.512138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a8808b5c5b41da9fd5667084441c87'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.528387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1138/2238] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:00 2022] DELETE /identity/v3/users/26a8808b5c5b41da9fd5667084441c87 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:00.726587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:00.727145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:00.728659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:00.730460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:00.751441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d60d-274f-4947-8675-ce652e466237 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:00.831214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:00.831982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.832338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.832697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] PATH_INFO: `/v3/projects/9d39a9cfc655462f9066fe8a91e48770` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.835679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d39a9cfc655462f9066fe8a91e48770)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.837542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:00.840852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd451a-5797-4f40-84f8-7d7d8ecc75f6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:00.847719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:00.852144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.853755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.854300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] PATH_INFO: `/v3/projects/da7d6de23e954153a5b215141ad4ee12` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.855476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7d6de23e954153a5b215141ad4ee12)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.857533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:00.904304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d39a9cfc655462f9066fe8a91e48770', 'request_id': 'req-38613ee1-fda2-4493-9fd8-659df6f0e0ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.914456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d39a9cfc655462f9066fe8a91e48770', 'request_id': 'req-38613ee1-fda2-4493-9fd8-659df6f0e0ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.920381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7d6de23e954153a5b215141ad4ee12', 'request_id': 'req-858be4fe-00c0-4340-a805-dc14d3f188ab'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.921127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d39a9cfc655462f9066fe8a91e48770', 'request_id': 'req-38613ee1-fda2-4493-9fd8-659df6f0e0ee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.927152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7d6de23e954153a5b215141ad4ee12', 'request_id': 'req-858be4fe-00c0-4340-a805-dc14d3f188ab'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.937910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] The token cache is being invalidate because project 9d39a9cfc655462f9066fe8a91e48770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:00.938413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.939194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-38613ee1-fda2-4493-9fd8-659df6f0e0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.939795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7d6de23e954153a5b215141ad4ee12', 'request_id': 'req-858be4fe-00c0-4340-a805-dc14d3f188ab'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.945186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1101/2239] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:00 2022] DELETE /identity/v3/projects/9d39a9cfc655462f9066fe8a91e48770 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:00.945186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.945186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.945186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.954828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] The token cache is being invalidate because project da7d6de23e954153a5b215141ad4ee12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:00.955119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.955793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-858be4fe-00c0-4340-a805-dc14d3f188ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:00.961269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1139/2240] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:00 2022] DELETE /identity/v3/projects/da7d6de23e954153a5b215141ad4ee12 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:00.961269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.961269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.961269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.976003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] MFA Rules not processed for user `46ed5291cafb4e01aabc11a6772eb59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:00.977290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:00.982436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:00.983623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.030549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:01.055944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1102/2241] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:01.056908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.058812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.061640 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1140/2242] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:01.063546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.065191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.073434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1bb87-13d2-41e8-b962-0e872e6e0f3a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.076347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:01.078990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.079623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.079896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.080224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] PATH_INFO: `/v3/users/1a919b34ff7b4d46b21ab4893ab7db81` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.081409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a919b34ff7b4d46b21ab4893ab7db81)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.084340 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.128792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e1106-09e2-44b7-b6ce-50bec3b5d298 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.133057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb924c70-8747-4bae-aaaa-ea5e4abde797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.133717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb924c70-8747-4bae-aaaa-ea5e4abde797 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.134005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb924c70-8747-4bae-aaaa-ea5e4abde797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.134275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb924c70-8747-4bae-aaaa-ea5e4abde797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.134947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a919b34ff7b4d46b21ab4893ab7db81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.135620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a919b34ff7b4d46b21ab4893ab7db81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.142903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb924c70-8747-4bae-aaaa-ea5e4abde797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.143083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a919b34ff7b4d46b21ab4893ab7db81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.144358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb924c70-8747-4bae-aaaa-ea5e4abde797 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.151175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a919b34ff7b4d46b21ab4893ab7db81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.151866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a919b34ff7b4d46b21ab4893ab7db81'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.154349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1141/2243] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:18:01.155760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca373-355e-427d-9b20-bf4f787b1c73 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.156050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca373-355e-427d-9b20-bf4f787b1c73 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.156319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ca373-355e-427d-9b20-bf4f787b1c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.175587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1103/2244] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:01 2022] DELETE /identity/v3/users/1a919b34ff7b4d46b21ab4893ab7db81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:01.179824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-706ca373-355e-427d-9b20-bf4f787b1c73 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:01.181422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-706ca373-355e-427d-9b20-bf4f787b1c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.249421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1142/2245] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:01.253999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.271556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fa081-879f-4362-b1e3-854c6b5910ea admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.281011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.281464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.281784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.282025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.282671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:01.282971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.284560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.297263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1104/2246] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:01.301621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ca373-355e-427d-9b20-bf4f787b1c73 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.311797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ca373-355e-427d-9b20-bf4f787b1c73 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.316877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.317193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.317440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.317761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.318995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.321555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.358701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1143/2247] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:01.359817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.374430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c0e7-9aae-4a5c-abd1-e0bd918bb478 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.375506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.378150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.478134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.478577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79107-ca49-4b7d-9032-6b17cb4647f4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.479380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.479852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.480305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.481145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.483330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.484634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.485268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.485606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.485983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] PATH_INFO: `/v3/projects/53f232b5a9db4374adaecc5de1ac321b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.487439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f232b5a9db4374adaecc5de1ac321b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.489486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.535154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1105/2248] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:01.540323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.557896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:01.561122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c2cc-a07f-4baf-b081-a0c8af1a80da admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.582306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f232b5a9db4374adaecc5de1ac321b', 'request_id': 'req-ae39b9f9-f23b-4387-897a-5b86ba6241d7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.594912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f232b5a9db4374adaecc5de1ac321b', 'request_id': 'req-ae39b9f9-f23b-4387-897a-5b86ba6241d7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.606693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:01.607167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f232b5a9db4374adaecc5de1ac321b', 'request_id': 'req-ae39b9f9-f23b-4387-897a-5b86ba6241d7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.625210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] The token cache is being invalidate because project 53f232b5a9db4374adaecc5de1ac321b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:01.625862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.626555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ae39b9f9-f23b-4387-897a-5b86ba6241d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:01.629824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1144/2249] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:01 2022] DELETE /identity/v3/projects/53f232b5a9db4374adaecc5de1ac321b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:01.635740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126fc5-2a35-4c7b-9471-2f1daaad5765 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.636359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126fc5-2a35-4c7b-9471-2f1daaad5765 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.636783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d126fc5-2a35-4c7b-9471-2f1daaad5765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.656061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.656705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.657072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.657266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.657917 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.659523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.660131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8d126fc5-2a35-4c7b-9471-2f1daaad5765 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:01.662527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8d126fc5-2a35-4c7b-9471-2f1daaad5765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.672622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1106/2250] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:01.676717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1145/2251] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:01.676888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.679548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.685337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6742-329c-4fcb-95c5-d3da5e54260e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.685797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6742-329c-4fcb-95c5-d3da5e54260e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.686308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6742-329c-4fcb-95c5-d3da5e54260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.694036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6a3c-1e6f-4543-85ed-f0d019541f63 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.699028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.699621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.699895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.700183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.700813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.702440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.714709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1107/2252] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:01.719204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.724737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-580c6742-329c-4fcb-95c5-d3da5e54260e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:01.726025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-580c6742-329c-4fcb-95c5-d3da5e54260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.732052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1519396-cca3-424b-88c8-da646c1e5208 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.734422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1146/2253] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:01.738309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c6742-329c-4fcb-95c5-d3da5e54260e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.738629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf9aed-d32a-414c-aff4-d079912c80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.739292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9aed-d32a-414c-aff4-d079912c80ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.739571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9aed-d32a-414c-aff4-d079912c80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.740413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9aed-d32a-414c-aff4-d079912c80ec admin admin] PATH_INFO: `/v3/projects/28b66a552aba4158a6ca15dfc82c8f86/users/c60d759f7d43411c91d2f18867654356/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.748852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c6742-329c-4fcb-95c5-d3da5e54260e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.753838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.754443 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.754790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.755122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.755924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:01.757889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.758020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.762808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf9aed-d32a-414c-aff4-d079912c80ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b66a552aba4158a6ca15dfc82c8f86, user_id=c60d759f7d43411c91d2f18867654356, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.766096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf9aed-d32a-414c-aff4-d079912c80ec admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.777954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1147/2254] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:18:01.781186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.794919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1108/2255] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:01 2022] PUT /identity/v3/projects/28b66a552aba4158a6ca15dfc82c8f86/users/c60d759f7d43411c91d2f18867654356/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:01.802956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ffed-b104-4bd5-ae9d-e6d1947b7ac4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.803324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ffed-b104-4bd5-ae9d-e6d1947b7ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.803666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ffed-b104-4bd5-ae9d-e6d1947b7ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.804301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450774-a35a-42fa-8764-246e5967844e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.828800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1710ffed-b104-4bd5-ae9d-e6d1947b7ac4 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:01.830281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1710ffed-b104-4bd5-ae9d-e6d1947b7ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.875572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.876909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.876909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.876909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.877643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.880246 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.913661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1109/2256] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:01.918039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1148/2257] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:01.919074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710ffed-b104-4bd5-ae9d-e6d1947b7ac4 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.920933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.930373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.932244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710ffed-b104-4bd5-ae9d-e6d1947b7ac4 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.998086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.998682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.999060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.999225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.999872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.001789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.009727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79001d-9c55-4375-803b-17b247e614b7 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.014356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.015238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.015695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.016020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.028444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1110/2258] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:02.030815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.032657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.034718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.044187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572def0-635e-4da7-83fd-68c9db168ee5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.048344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1149/2259] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:02.048911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.049649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.049925 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.050196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.051390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.052803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.064351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1111/2260] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:18:02.070389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.082793 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff640b20-dfdb-434f-bc90-1a56165afdc9 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.088475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf11b5-635b-4b3d-b506-cec156f4b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.089075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf11b5-635b-4b3d-b506-cec156f4b71a admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.089350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf11b5-635b-4b3d-b506-cec156f4b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.089934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf11b5-635b-4b3d-b506-cec156f4b71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.090289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf11b5-635b-4b3d-b506-cec156f4b71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.091859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf11b5-635b-4b3d-b506-cec156f4b71a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.103219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1150/2261] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:02.107554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.123846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657047c-a570-4d2f-be3c-c027eb444b0c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.129856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.130634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.130969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.131304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] PATH_INFO: `/v3/projects/d8a16daa33eb4dbaad66503c0a33a390/users/c61bc341544e4e898ccca303e4d4bb60/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.147617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:02.150133 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a16daa33eb4dbaad66503c0a33a390, user_id=c61bc341544e4e898ccca303e4d4bb60, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.153183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.177431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1112/2262] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:02 2022] PUT /identity/v3/projects/d8a16daa33eb4dbaad66503c0a33a390/users/c61bc341544e4e898ccca303e4d4bb60/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:02.178844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ba33-6fbc-4608-87f5-9c31c2267a02 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.179166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ba33-6fbc-4608-87f5-9c31c2267a02 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.179445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ba33-6fbc-4608-87f5-9c31c2267a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.205589 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:02.218473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5ad1ba33-6fbc-4608-87f5-9c31c2267a02 None None] MFA Rules not processed for user `c61bc341544e4e898ccca303e4d4bb60`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:02.219932 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5ad1ba33-6fbc-4608-87f5-9c31c2267a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:02.311384 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1151/2263] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:02.322751 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.324369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:02.407014 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd107d-e9b1-4885-925b-9ceb240228fe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.411025 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.411804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.412083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.412353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.422177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.423610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.433440 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1113/2264] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:02.653260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8921c-935d-412c-8a10-b18de5ee375a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.654571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8921c-935d-412c-8a10-b18de5ee375a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.655438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8921c-935d-412c-8a10-b18de5ee375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.679802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a7f8921c-935d-412c-8a10-b18de5ee375a None None] MFA Rules not processed for user `46ed5291cafb4e01aabc11a6772eb59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:02.681242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a7f8921c-935d-412c-8a10-b18de5ee375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:02.795116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1152/2265] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:05.808365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:05.913074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee7a3-f288-49ba-9ebf-4fb96964a8ab service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:05.919052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:05.919699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:05.920023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:05.920295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] PATH_INFO: `/v3/users/c61bc341544e4e898ccca303e4d4bb60` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:05.921490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61bc341544e4e898ccca303e4d4bb60)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:05.923841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:05.996234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61bc341544e4e898ccca303e4d4bb60'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.000104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61bc341544e4e898ccca303e4d4bb60'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.010793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61bc341544e4e898ccca303e4d4bb60'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.023268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61bc341544e4e898ccca303e4d4bb60'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.024194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61bc341544e4e898ccca303e4d4bb60'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.051910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1114/2266] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:05 2022] DELETE /identity/v3/users/c61bc341544e4e898ccca303e4d4bb60 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:06.057258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:06.057923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:06.057923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:06.077610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:06.078943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:06.164202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1153/2267] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:06.174781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:06.176261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:06.195352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:06.257625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e75736-3040-47b3-9bb1-91e473c6b469 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:06.261419 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb84d-369b-4944-a008-2b8701302897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:06.262204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb84d-369b-4944-a008-2b8701302897 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:06.262488 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb84d-369b-4944-a008-2b8701302897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:06.262760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb84d-369b-4944-a008-2b8701302897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:06.273040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb84d-369b-4944-a008-2b8701302897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:06.274890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb84d-369b-4944-a008-2b8701302897 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:06.288306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1115/2268] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:06.675369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:06.676827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:06.695483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e502666-951a-4cd9-a58c-ae498987b61c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:06.709013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:06.710198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:06.710733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:06.711207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] PATH_INFO: `/v3/projects/d8a16daa33eb4dbaad66503c0a33a390` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:06.729085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a16daa33eb4dbaad66503c0a33a390)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:06.740467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:06.844342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:06.860173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a16daa33eb4dbaad66503c0a33a390', 'request_id': 'req-6d529721-aae9-4e18-9066-3737b83af5d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.869703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a16daa33eb4dbaad66503c0a33a390', 'request_id': 'req-6d529721-aae9-4e18-9066-3737b83af5d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.892889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a16daa33eb4dbaad66503c0a33a390', 'request_id': 'req-6d529721-aae9-4e18-9066-3737b83af5d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.939914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] The token cache is being invalidate because project d8a16daa33eb4dbaad66503c0a33a390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:06.940714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.942530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-6d529721-aae9-4e18-9066-3737b83af5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.945407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1154/2269] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:06 2022] DELETE /identity/v3/projects/d8a16daa33eb4dbaad66503c0a33a390 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:06.950781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecf56-de7f-47f1-9a3d-4ab22c4c3aec None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:06.951976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecf56-de7f-47f1-9a3d-4ab22c4c3aec None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:06.952548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecf56-de7f-47f1-9a3d-4ab22c4c3aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:06.983412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8bdecf56-de7f-47f1-9a3d-4ab22c4c3aec None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:06.985482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8bdecf56-de7f-47f1-9a3d-4ab22c4c3aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:07.098198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1116/2270] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:07.106190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98df69-e6c7-4518-b4b9-cee43253ea38 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.107129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98df69-e6c7-4518-b4b9-cee43253ea38 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.107706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98df69-e6c7-4518-b4b9-cee43253ea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.157180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0e98df69-e6c7-4518-b4b9-cee43253ea38 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:07.158660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0e98df69-e6c7-4518-b4b9-cee43253ea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:07.170409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1155/2271] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:07.176001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecf56-de7f-47f1-9a3d-4ab22c4c3aec None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.192202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecf56-de7f-47f1-9a3d-4ab22c4c3aec None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.202877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.203652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.203932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.204201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.204862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:07.205162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.209728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.227929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1117/2272] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:07.232273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98df69-e6c7-4518-b4b9-cee43253ea38 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.247564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98df69-e6c7-4518-b4b9-cee43253ea38 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.254502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.256119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.256604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.257307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.258238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.264482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.334753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1156/2273] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:07 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:07.339083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.349539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b0f2d-e3cb-46a4-83a4-5d75adb46f76 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.427706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.429035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.429316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.429670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.430314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.432260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.460705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1118/2274] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:07 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:07.465132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.477489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d009c-613e-488d-ab7d-4c9b96e11f18 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.482884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.483611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.483947 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.484282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.485033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.486913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.500501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1157/2275] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:07.504902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.515974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998d3c3-b862-41fa-a224-9d275c40a49e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.521355 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616f96f-5c1f-4b53-8e65-95d8febd7ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.522108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f96f-5c1f-4b53-8e65-95d8febd7ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.522456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f96f-5c1f-4b53-8e65-95d8febd7ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.522792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f96f-5c1f-4b53-8e65-95d8febd7ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.523518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616f96f-5c1f-4b53-8e65-95d8febd7ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.525193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616f96f-5c1f-4b53-8e65-95d8febd7ce0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.538170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1119/2276] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:07.542473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.554370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1b9db-06db-410a-8197-bb5766d6674c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.559659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.560410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.560751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.561026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] PATH_INFO: `/v3/projects/c04d2a5303ad4d7899a496f569728753/users/493a4174006a4463813145b80c89c52c/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.585928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04d2a5303ad4d7899a496f569728753, user_id=493a4174006a4463813145b80c89c52c, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.589021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.610960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1158/2277] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:07 2022] PUT /identity/v3/projects/c04d2a5303ad4d7899a496f569728753/users/493a4174006a4463813145b80c89c52c/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:07.623110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143436-89bd-45f6-800e-31b29bfe36de None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.623395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143436-89bd-45f6-800e-31b29bfe36de None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.623667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143436-89bd-45f6-800e-31b29bfe36de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.662173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9f143436-89bd-45f6-800e-31b29bfe36de None None] MFA Rules not processed for user `493a4174006a4463813145b80c89c52c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:07.663587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9f143436-89bd-45f6-800e-31b29bfe36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:07.676288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:07.751979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1120/2278] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:07.752896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.822940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d469a-a2ad-415d-857f-2a1998e94a0b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.832376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.833258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.834259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.834556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.835300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.843394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.882240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1159/2279] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:07 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:07.886718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f143436-89bd-45f6-800e-31b29bfe36de None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:07.907501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f143436-89bd-45f6-800e-31b29bfe36de None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.987675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.988908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.989185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.989585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.990260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.993610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.027252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1121/2280] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:07 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:18:08.031090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.045074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569bf8f-04d5-40cc-9fc0-7402b22bba0f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.052902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.053717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.054003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.054266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.054911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.056730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.070066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1160/2281] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:18:08.075643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.088772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae640d6-5411-4f95-ae4f-05262faba4c5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.114217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6c73a-19d9-4eb3-8f1d-b1718dcd868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.114905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c73a-19d9-4eb3-8f1d-b1718dcd868f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.115196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c73a-19d9-4eb3-8f1d-b1718dcd868f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.115524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c73a-19d9-4eb3-8f1d-b1718dcd868f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.116141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6c73a-19d9-4eb3-8f1d-b1718dcd868f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.117823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6c73a-19d9-4eb3-8f1d-b1718dcd868f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.158407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1122/2282] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:08.159734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.171851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79f49-056e-485e-a981-71468b507084 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.185952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.186746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.187023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.187300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] PATH_INFO: `/v3/projects/02620655f71e46d89987fb8707c99b3e/users/178c4572cc1547de818fbda3434de4e5/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.220387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02620655f71e46d89987fb8707c99b3e, user_id=178c4572cc1547de818fbda3434de4e5, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.223743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.252457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1161/2283] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:08 2022] PUT /identity/v3/projects/02620655f71e46d89987fb8707c99b3e/users/178c4572cc1547de818fbda3434de4e5/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:08.254278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5102e7-c33a-41c9-b20a-d0cc1941a462 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.254806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5102e7-c33a-41c9-b20a-d0cc1941a462 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.255807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5102e7-c33a-41c9-b20a-d0cc1941a462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.308971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8f5102e7-c33a-41c9-b20a-d0cc1941a462 None None] MFA Rules not processed for user `178c4572cc1547de818fbda3434de4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:08.311707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8f5102e7-c33a-41c9-b20a-d0cc1941a462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:08.442490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1123/2284] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:08.447631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.475404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:08.549579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.549875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.550141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.557962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85077-56a4-4c2e-ab7a-1a9e1b16d20a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.563842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.564872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.565347 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.566582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.567420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.570642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.602435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] MFA Rules not processed for user `c60d759f7d43411c91d2f18867654356`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:08.604812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:08.611948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1162/2285] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:08 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:08.613703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.621707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:08.699101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126acdf-bb7e-418d-b572-b929610c85d7 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.704774 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.705620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.706517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.706811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.707456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.710275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.720532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1124/2286] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:08.721585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.723064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:08.741074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1163/2287] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:08 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:08.741271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dec5d-4373-4955-9827-db2508ac5950 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.742279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.745915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.746597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.746948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.747230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.747865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.749833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.754421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf86f-1a1b-47d9-b4d5-32cb957988fc admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.759574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.761435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.761764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.762060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.762686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.770449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.784381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1164/2288] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:08.785482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1125/2289] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:08 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:08.789012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.790318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.801021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6069fe-7776-4107-9dcc-60b61f41779d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.877896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.878113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.878376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.878823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] PATH_INFO: `/v3/projects/cb637e9838694392923de4f9ea6a3b09/users/2e65569dd5d74a7fbd5a369a1e8d5d00/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.894153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd3e1-698d-4bd5-83bf-455fab07e401 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:08.895693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb637e9838694392923de4f9ea6a3b09, user_id=2e65569dd5d74a7fbd5a369a1e8d5d00, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.899225 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.899590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:08.900267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:08.900615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:08.900959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:08.901710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:08.904606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:08.918618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1165/2290] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:08 2022] PUT /identity/v3/projects/cb637e9838694392923de4f9ea6a3b09/users/2e65569dd5d74a7fbd5a369a1e8d5d00/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:08.924212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.930538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:08.936886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1126/2291] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:08 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:08.941177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.960180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47403adc-dc78-4baf-ad9d-67e044092d88 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.013731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997a70-000d-48c5-b1f6-95dcb37a06b2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.021486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.022481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.022773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.023150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.023907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.025966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.054248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1166/2292] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:18:09.055282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:09.080989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.081722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.082070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.082410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.083923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.085361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6b9cb-2ec8-461e-b1db-d2a4dd2be8d6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.085789 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.091037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79d7ce-8850-4c18-83cc-d5b88144508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.091869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79d7ce-8850-4c18-83cc-d5b88144508f admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.092381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79d7ce-8850-4c18-83cc-d5b88144508f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.092983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79d7ce-8850-4c18-83cc-d5b88144508f admin admin] PATH_INFO: `/v3/projects/cb637e9838694392923de4f9ea6a3b09/users/2e65569dd5d74a7fbd5a369a1e8d5d00/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.095516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79d7ce-8850-4c18-83cc-d5b88144508f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb637e9838694392923de4f9ea6a3b09, user_id=2e65569dd5d74a7fbd5a369a1e8d5d00, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.101570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1127/2293] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:09.101712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79d7ce-8850-4c18-83cc-d5b88144508f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.103222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:09.117159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618c8e1-4692-4ceb-84dc-bd510cbf1ddb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.124973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1167/2294] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:09 2022] PUT /identity/v3/projects/cb637e9838694392923de4f9ea6a3b09/users/2e65569dd5d74a7fbd5a369a1e8d5d00/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:09.127089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.127368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.127639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.131641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:09.168732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] MFA Rules not processed for user `2e65569dd5d74a7fbd5a369a1e8d5d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:09.170403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:09.195490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.196455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.196855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.197334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] PATH_INFO: `/v3/projects/accc53bed50b495285c15cd21075a669/users/3fbf089613504991a44efc8331f7ee4b/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.223835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accc53bed50b495285c15cd21075a669, user_id=3fbf089613504991a44efc8331f7ee4b, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.226855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.247329 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1128/2295] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:09 2022] PUT /identity/v3/projects/accc53bed50b495285c15cd21075a669/users/3fbf089613504991a44efc8331f7ee4b/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:09.252159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:09.278525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1168/2296] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:09.290412 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:09.292346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:09.345595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96011da-6f96-49a0-b0f9-60e703788a69 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.352402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.353365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.354005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.354478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.355655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.358504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.360385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036e61-09c0-4905-bb54-fb78806eeada None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.374144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1129/2297] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:09.377804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:09.389173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:09.394808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793cc82-992f-4de0-86df-76cfec4d8e86 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.403377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.404192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.404710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.405084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] PATH_INFO: `/v3/projects/accc53bed50b495285c15cd21075a669/users/3fbf089613504991a44efc8331f7ee4b/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.407203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accc53bed50b495285c15cd21075a669, user_id=3fbf089613504991a44efc8331f7ee4b, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.410793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.420773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.421387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.421699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.421992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.425823 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1130/2298] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:09 2022] PUT /identity/v3/projects/accc53bed50b495285c15cd21075a669/users/3fbf089613504991a44efc8331f7ee4b/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:09.506762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.508695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.531043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1169/2299] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:11.435398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:11.437895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:11.515470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee8b2f-e696-4895-99f0-229e69e3e367 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:11.519845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:11.521311 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:11.521665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:11.521944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:11.593555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:11.670016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:11.671654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:11.684050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1131/2300] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:12.680445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.690755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e61fc-8c1b-4d39-9c36-dcd26a6963f0 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:12.697301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f806a0-a398-4654-9f92-c575adcbec00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:12.705772 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f806a0-a398-4654-9f92-c575adcbec00 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.707547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f806a0-a398-4654-9f92-c575adcbec00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.710062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f806a0-a398-4654-9f92-c575adcbec00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.845867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f806a0-a398-4654-9f92-c575adcbec00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:12.847528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f806a0-a398-4654-9f92-c575adcbec00 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.871417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1170/2301] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:14.515043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:14.516550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:14.590485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ecd1b-49ec-49e9-a48b-f37dec4d91b8 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:14.597930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:14.598785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.599384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.599837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] PATH_INFO: `/v3/users/1e3b03d066634607bc48a888e1269cef` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.601145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3b03d066634607bc48a888e1269cef)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:14.603267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:14.659527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3b03d066634607bc48a888e1269cef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:14.660450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3b03d066634607bc48a888e1269cef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:14.667924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3b03d066634607bc48a888e1269cef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:14.678119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3b03d066634607bc48a888e1269cef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:14.679279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3b03d066634607bc48a888e1269cef'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:14.704040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1132/2302] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:14 2022] DELETE /identity/v3/users/1e3b03d066634607bc48a888e1269cef => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:14.708969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf86ea-3046-403a-9e25-fb4bc0a521ce None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.709827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf86ea-3046-403a-9e25-fb4bc0a521ce None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.710349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf86ea-3046-403a-9e25-fb4bc0a521ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.751904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-75cf86ea-3046-403a-9e25-fb4bc0a521ce None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:14.753222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-75cf86ea-3046-403a-9e25-fb4bc0a521ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:14.821754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1171/2303] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:14.834322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:14.839864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:14.961855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b186d-2b5d-4cce-a276-d22cc15ee039 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:14.966284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:14.967155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.967613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.968027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.976860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:14.981063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:14.983346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:15.001713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1133/2304] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:15.212284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d70-1386-449b-a609-2e6d484967dc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:15.212661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d70-1386-449b-a609-2e6d484967dc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:15.213069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d70-1386-449b-a609-2e6d484967dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:15.244686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-06696d70-1386-449b-a609-2e6d484967dc None None] MFA Rules not processed for user `3fbf089613504991a44efc8331f7ee4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:15.246092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-06696d70-1386-449b-a609-2e6d484967dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.251831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:15.334207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1172/2305] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:15.346739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:15.348028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.449535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d70-1386-449b-a609-2e6d484967dc None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:15.449535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-06696d70-1386-449b-a609-2e6d484967dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.474417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4af7-45f0-4dc5-af3c-29b65bf3f109 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:15.483598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb82f3-5225-43d1-8c25-0ab8ea3c2c1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa77ec9b56cd4027b22fbe0d7ff3ee1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:15.484297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb82f3-5225-43d1-8c25-0ab8ea3c2c1d service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:15.484555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb82f3-5225-43d1-8c25-0ab8ea3c2c1d service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:15.484829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb82f3-5225-43d1-8c25-0ab8ea3c2c1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:15.487878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7fbb82f3-5225-43d1-8c25-0ab8ea3c2c1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.488708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d70-1386-449b-a609-2e6d484967dc None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:15.504511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:15.505230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:15.506060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:15.506333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] PATH_INFO: `/v3/projects/4dcb6609ac1540c9a9278768739269bd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:15.507784 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcb6609ac1540c9a9278768739269bd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:15.510751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:15.619062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb82f3-5225-43d1-8c25-0ab8ea3c2c1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:15.621039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb82f3-5225-43d1-8c25-0ab8ea3c2c1d service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:15.630948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcb6609ac1540c9a9278768739269bd', 'request_id': 'req-ea5a164a-5d60-4419-a2e8-8c8a3d640210'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:15.639301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcb6609ac1540c9a9278768739269bd', 'request_id': 'req-ea5a164a-5d60-4419-a2e8-8c8a3d640210'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:15.640248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1134/2306] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:15.649695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcb6609ac1540c9a9278768739269bd', 'request_id': 'req-ea5a164a-5d60-4419-a2e8-8c8a3d640210'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:15.671250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] The token cache is being invalidate because project 4dcb6609ac1540c9a9278768739269bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:15.671986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:15.687539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ea5a164a-5d60-4419-a2e8-8c8a3d640210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:15.690665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1173/2307] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:15 2022] DELETE /identity/v3/projects/4dcb6609ac1540c9a9278768739269bd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:15.696041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b63e7f-3232-4462-9975-0e47a9388e02 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:15.696327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b63e7f-3232-4462-9975-0e47a9388e02 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:15.696675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b63e7f-3232-4462-9975-0e47a9388e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:15.753560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-31b63e7f-3232-4462-9975-0e47a9388e02 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:15.754793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-31b63e7f-3232-4462-9975-0e47a9388e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.903130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1135/2308] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:15.910598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8ec6-7ebb-471f-95ad-c8cfe9c7cdf5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:15.911628 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8ec6-7ebb-471f-95ad-c8cfe9c7cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:15.912425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8ec6-7ebb-471f-95ad-c8cfe9c7cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:15.963367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-51ad8ec6-7ebb-471f-95ad-c8cfe9c7cdf5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:15.964674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-51ad8ec6-7ebb-471f-95ad-c8cfe9c7cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.985463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1174/2309] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:15.991093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b63e7f-3232-4462-9975-0e47a9388e02 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:15.991893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2dcff-3be7-4425-8528-57e1bca6c8c0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:15.992375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2dcff-3be7-4425-8528-57e1bca6c8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:15.992805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2dcff-3be7-4425-8528-57e1bca6c8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.004409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b63e7f-3232-4462-9975-0e47a9388e02 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.015487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.016481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.016653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.016923 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.018183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:16.018183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.020002 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.023396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-76b2dcff-3be7-4425-8528-57e1bca6c8c0 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:16.024925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-76b2dcff-3be7-4425-8528-57e1bca6c8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.044403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1136/2310] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:16.045830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.059607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2d172-bcac-49c4-9a75-dddc1905909d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.081868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.082824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.082824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.083354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.084941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.087099 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.167233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1175/2311] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:18:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:16.170918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1137/2312] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:16 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:16.178736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2dcff-3be7-4425-8528-57e1bca6c8c0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.201191 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2dcff-3be7-4425-8528-57e1bca6c8c0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.229137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:16.237194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.240236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.293484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.294354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.294638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.295016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.295825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.298881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.336550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:16.352106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1176/2313] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:16 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:16.358190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.372003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d58a-6ba8-48c0-87d0-646e9a260342 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.386196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.387189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.387689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.388185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.389473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.391381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.403977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1177/2314] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:16.407489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.419395 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09ffe-8b72-4397-ba8f-78addd9de2ec admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.424699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.425693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.426711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.427833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.428918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.435301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.442132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b978b2-4ec3-45ef-8b2d-8fdee751ab03 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.450356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1178/2315] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:16.453442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.460110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.460809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.461277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.461816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.477843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf12c5a-43b9-4122-a9ce-7c4af0059fd2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.484025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7ef16-71e4-4a0d-af7d-6eb9cd265521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.484719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ef16-71e4-4a0d-af7d-6eb9cd265521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.485040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ef16-71e4-4a0d-af7d-6eb9cd265521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.485353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7ef16-71e4-4a0d-af7d-6eb9cd265521 admin admin] PATH_INFO: `/v3/projects/472bec25a6b84f67bdf8e03422947918/users/613b6c65815e45a9aad98d69e1054c31/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.511085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ef16-71e4-4a0d-af7d-6eb9cd265521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472bec25a6b84f67bdf8e03422947918, user_id=613b6c65815e45a9aad98d69e1054c31, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.515491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7ef16-71e4-4a0d-af7d-6eb9cd265521 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.545196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1179/2316] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:16 2022] PUT /identity/v3/projects/472bec25a6b84f67bdf8e03422947918/users/613b6c65815e45a9aad98d69e1054c31/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:16.547973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.549847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.560632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.560933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.561152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.570134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1138/2317] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:18:16.620260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] MFA Rules not processed for user `613b6c65815e45a9aad98d69e1054c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:16.622058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.707564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1180/2318] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:16.724640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.726968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.831198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479635a5-7b88-4238-8371-171ca5caa386 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.939072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275dc28-de98-42c8-92a7-86059b46ceba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.940155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275dc28-de98-42c8-92a7-86059b46ceba service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.940614 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275dc28-de98-42c8-92a7-86059b46ceba service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.941104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275dc28-de98-42c8-92a7-86059b46ceba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.951361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275dc28-de98-42c8-92a7-86059b46ceba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.952939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275dc28-de98-42c8-92a7-86059b46ceba service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.965262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1139/2319] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:17.657983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:17.660523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:17.805956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:17.814067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf922-c2af-4b86-8e1b-25b58efd96cf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:17.821394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:17.822610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:17.823254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:17.823733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] PATH_INFO: `/v3/users/493a4174006a4463813145b80c89c52c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:17.825114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493a4174006a4463813145b80c89c52c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:17.827505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:17.930754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493a4174006a4463813145b80c89c52c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:17.931426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493a4174006a4463813145b80c89c52c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:17.963607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493a4174006a4463813145b80c89c52c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:17.990399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493a4174006a4463813145b80c89c52c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:17.991206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493a4174006a4463813145b80c89c52c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.025847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1181/2320] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:17 2022] DELETE /identity/v3/users/493a4174006a4463813145b80c89c52c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:18.030620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:18.032054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:18.032722 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.072332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:18.073834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:18.110155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:18.211833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1140/2321] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:18.222174 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:18.227342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:18.363531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a5268-7a0c-463b-b13b-c5aef64fe9a5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:18.371430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:18.372292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:18.372415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:18.372632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.407943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:18.410290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:18.430226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1182/2322] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:19.137274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:19.139784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:19.185691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107ca7c-5abe-4005-9211-f4e75b9b568a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:19.195813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:19.197013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:19.197453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:19.197986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] PATH_INFO: `/v3/projects/c04d2a5303ad4d7899a496f569728753` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:19.199290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04d2a5303ad4d7899a496f569728753)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:19.201743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:19.302513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04d2a5303ad4d7899a496f569728753', 'request_id': 'req-c88616b6-b25b-4412-8c61-004cd7e34c92'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.318074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04d2a5303ad4d7899a496f569728753', 'request_id': 'req-c88616b6-b25b-4412-8c61-004cd7e34c92'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.331288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04d2a5303ad4d7899a496f569728753', 'request_id': 'req-c88616b6-b25b-4412-8c61-004cd7e34c92'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.351707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] The token cache is being invalidate because project c04d2a5303ad4d7899a496f569728753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:19.352364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.353360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.355096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1141/2323] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:19 2022] DELETE /identity/v3/projects/c04d2a5303ad4d7899a496f569728753 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:19.359587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:19.376227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23225-cc0d-4dd8-b31e-5cb3e20975e2 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:19.587564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:19.588276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:19.588545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:19.588834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] PATH_INFO: `/v3/users/178c4572cc1547de818fbda3434de4e5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:19.594134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=178c4572cc1547de818fbda3434de4e5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:19.595834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:19.654741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:19.749596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178c4572cc1547de818fbda3434de4e5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.750384 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178c4572cc1547de818fbda3434de4e5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.805460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178c4572cc1547de818fbda3434de4e5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.820926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178c4572cc1547de818fbda3434de4e5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.822937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178c4572cc1547de818fbda3434de4e5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:19.861114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1183/2324] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:19 2022] DELETE /identity/v3/users/178c4572cc1547de818fbda3434de4e5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:20.643238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:20.645613 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:20.674825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88616b6-b25b-4412-8c61-004cd7e34c92 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:20.815545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:20.816558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:20.817111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:20.817483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] PATH_INFO: `/v3/projects/02620655f71e46d89987fb8707c99b3e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:20.819762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] RBAC: Authorizing `identity:delete_project(project_id=02620655f71e46d89987fb8707c99b3e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:20.827651 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:20.896331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:20.904507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02620655f71e46d89987fb8707c99b3e', 'request_id': 'req-985b0a53-2f28-47c7-b75c-c79a0f48984f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.915662 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02620655f71e46d89987fb8707c99b3e', 'request_id': 'req-985b0a53-2f28-47c7-b75c-c79a0f48984f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.923357 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02620655f71e46d89987fb8707c99b3e', 'request_id': 'req-985b0a53-2f28-47c7-b75c-c79a0f48984f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.947524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] The token cache is being invalidate because project 02620655f71e46d89987fb8707c99b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:20.947940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.948634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.950585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1142/2325] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:20 2022] DELETE /identity/v3/projects/02620655f71e46d89987fb8707c99b3e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:20.954598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:20.956208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:20.986041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc34b0-a558-4270-8f3a-e208dc109db0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:21.137541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:21.138496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:21.138968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:21.139593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] PATH_INFO: `/v3/users/2e65569dd5d74a7fbd5a369a1e8d5d00` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:21.141005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e65569dd5d74a7fbd5a369a1e8d5d00)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:21.143447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:21.243308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e65569dd5d74a7fbd5a369a1e8d5d00'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:21.244008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e65569dd5d74a7fbd5a369a1e8d5d00'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:21.266308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e65569dd5d74a7fbd5a369a1e8d5d00'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:21.281350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e65569dd5d74a7fbd5a369a1e8d5d00'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:21.283871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-50e944c3-e2a5-4951-837a-e4639bf3d36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e65569dd5d74a7fbd5a369a1e8d5d00'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:21.310091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1184/2326] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:20 2022] DELETE /identity/v3/users/2e65569dd5d74a7fbd5a369a1e8d5d00 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:21.990387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:21.992432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:22.018910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b0a53-2f28-47c7-b75c-c79a0f48984f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:22.149630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:22.149883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.150033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.150303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] PATH_INFO: `/v3/projects/cb637e9838694392923de4f9ea6a3b09` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.154448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb637e9838694392923de4f9ea6a3b09)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:22.156136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:22.262136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb637e9838694392923de4f9ea6a3b09', 'request_id': 'req-6d16e735-c8a2-4dd1-b01b-29c04fae431a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:22.283086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb637e9838694392923de4f9ea6a3b09', 'request_id': 'req-6d16e735-c8a2-4dd1-b01b-29c04fae431a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:22.298438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb637e9838694392923de4f9ea6a3b09', 'request_id': 'req-6d16e735-c8a2-4dd1-b01b-29c04fae431a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:22.338849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] The token cache is being invalidate because project cb637e9838694392923de4f9ea6a3b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:22.343454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:22.344443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6d16e735-c8a2-4dd1-b01b-29c04fae431a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:22.346641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1143/2327] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:21 2022] DELETE /identity/v3/projects/cb637e9838694392923de4f9ea6a3b09 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:22.352281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7758-4c32-47a8-bf68-146ee337e3a0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.352281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7758-4c32-47a8-bf68-146ee337e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.352927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7758-4c32-47a8-bf68-146ee337e3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.399944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5a0f7758-4c32-47a8-bf68-146ee337e3a0 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:22.404319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5a0f7758-4c32-47a8-bf68-146ee337e3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:22.445945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:22.586927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1185/2328] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:22.587277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a2d5b-189f-41a7-82ed-2db4c76ef7d7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.587708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a2d5b-189f-41a7-82ed-2db4c76ef7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.588121 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a2d5b-189f-41a7-82ed-2db4c76ef7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.637226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0e6a2d5b-189f-41a7-82ed-2db4c76ef7d7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:22.638677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0e6a2d5b-189f-41a7-82ed-2db4c76ef7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:22.666555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7758-4c32-47a8-bf68-146ee337e3a0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:22.667089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1144/2329] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:22.692355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7758-4c32-47a8-bf68-146ee337e3a0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:22.700113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:22.701323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.702206 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.702688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.714819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:22.714819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:22.714819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:22.757055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a2d5b-189f-41a7-82ed-2db4c76ef7d7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:22.761850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1186/2330] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:22.770590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a2d5b-189f-41a7-82ed-2db4c76ef7d7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:22.789468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:22.790074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.790366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.790665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.791404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:22.793611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:22.871716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1145/2331] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:22.873218 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:22.887896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5285b56-fb57-4105-a467-d1eb0729c423 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.066413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.067389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.068552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.068924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.070162 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.078711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.166236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1187/2332] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:22 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:23.170799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:23.188980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6c83-b1ca-4065-b7b5-41180e6385c2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.222843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.223624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.224522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.225793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.226557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.229321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.264050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1146/2333] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:23.268320 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:23.282701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdcae-a9ac-4d21-9ead-8d1dc7abf7f4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.291340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f014e5-7435-472c-965b-07bdf964e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.292018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f014e5-7435-472c-965b-07bdf964e276 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.292491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f014e5-7435-472c-965b-07bdf964e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.292861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f014e5-7435-472c-965b-07bdf964e276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.293664 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f014e5-7435-472c-965b-07bdf964e276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.295650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f014e5-7435-472c-965b-07bdf964e276 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.320982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1188/2334] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:18:23.325891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:23.345831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4ec62-a7fc-4e24-b6a0-efc851038ec8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.353983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.354875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.355214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.355602 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] PATH_INFO: `/v3/projects/a6ec419d161849df9ef7d9a9a80b79fb/users/cd0109ea91e84b1583eb312bc2892887/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.379804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec419d161849df9ef7d9a9a80b79fb, user_id=cd0109ea91e84b1583eb312bc2892887, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.384596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.388916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:23.419462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1147/2335] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:23 2022] PUT /identity/v3/projects/a6ec419d161849df9ef7d9a9a80b79fb/users/cd0109ea91e84b1583eb312bc2892887/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:23.430649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15d12-ab38-4148-a3ac-14749a5a3c2c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.431190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15d12-ab38-4148-a3ac-14749a5a3c2c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.431190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15d12-ab38-4148-a3ac-14749a5a3c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.510377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5bd15d12-ab38-4148-a3ac-14749a5a3c2c None None] MFA Rules not processed for user `cd0109ea91e84b1583eb312bc2892887`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:23.511867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5bd15d12-ab38-4148-a3ac-14749a5a3c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:23.736031 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1189/2336] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:23.795491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:23.797458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:23.928253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a208fa-3991-4c64-9087-a26ffd6ba5ac admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:23.946824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:23.947464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:23.947755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:23.948015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:23.974543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:23.976134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:23.989232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1148/2337] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:25.861376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135277f-642e-42ff-88d9-e6134787d5aa None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:25.862521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135277f-642e-42ff-88d9-e6134787d5aa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:25.863007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135277f-642e-42ff-88d9-e6134787d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:25.906718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e135277f-642e-42ff-88d9-e6134787d5aa None None] MFA Rules not processed for user `46ed5291cafb4e01aabc11a6772eb59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:25.909380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e135277f-642e-42ff-88d9-e6134787d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:25.924182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:26.050588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1190/2338] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:27.275483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:27.418834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3e073-f9ac-491c-8b94-d5f71bdb043a service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:27.433395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:27.433994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:27.434275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:27.434548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] PATH_INFO: `/v3/users/cd0109ea91e84b1583eb312bc2892887` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:27.437456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0109ea91e84b1583eb312bc2892887)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:27.440065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:27.566611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0109ea91e84b1583eb312bc2892887'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:27.567808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0109ea91e84b1583eb312bc2892887'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:27.590911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0109ea91e84b1583eb312bc2892887'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:27.603432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0109ea91e84b1583eb312bc2892887'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:27.606775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0109ea91e84b1583eb312bc2892887'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:27.663652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1149/2339] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:27 2022] DELETE /identity/v3/users/cd0109ea91e84b1583eb312bc2892887 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:27.668333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6826-548c-4521-a465-82314d717631 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:27.668931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6826-548c-4521-a465-82314d717631 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:27.668931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b6826-548c-4521-a465-82314d717631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:27.695536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5c4b6826-548c-4521-a465-82314d717631 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:27.696770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5c4b6826-548c-4521-a465-82314d717631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:27.855447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1191/2340] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:27.869813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:27.871507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:27.911339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:27.999255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764cd4e-db3d-45f4-a78a-5ebd687458e1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:28.007688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:28.008698 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:28.009318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:28.009802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:28.022453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:28.024736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:28.038387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1150/2341] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:28.131323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce731ee-810f-40d8-bf23-2303abf6d828 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:28.131728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce731ee-810f-40d8-bf23-2303abf6d828 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:28.132231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce731ee-810f-40d8-bf23-2303abf6d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:28.178389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bce731ee-810f-40d8-bf23-2303abf6d828 None None] MFA Rules not processed for user `6d217e30149d4b51817d3770c80f81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:28.198704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bce731ee-810f-40d8-bf23-2303abf6d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:28.336797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1192/2342] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:28.697999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:28.697999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:28.721137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402644d4-8441-4cd1-9a5e-3d6bc1381185 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:28.747916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:28.748515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:28.748803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:28.749084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] PATH_INFO: `/v3/projects/a6ec419d161849df9ef7d9a9a80b79fb` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:28.755312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ec419d161849df9ef7d9a9a80b79fb)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:28.757264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:28.888079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ec419d161849df9ef7d9a9a80b79fb', 'request_id': 'req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:28.899913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ec419d161849df9ef7d9a9a80b79fb', 'request_id': 'req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:28.911175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ec419d161849df9ef7d9a9a80b79fb', 'request_id': 'req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:28.925611 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] The token cache is being invalidate because project a6ec419d161849df9ef7d9a9a80b79fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:28.926094 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:28.927074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6afddfa6-ed08-4bc1-9984-347fb4fc6d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:28.929173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1151/2343] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:28 2022] DELETE /identity/v3/projects/a6ec419d161849df9ef7d9a9a80b79fb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:28.936970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0226-97f8-4fd8-b224-885f508212b9 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:28.937615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0226-97f8-4fd8-b224-885f508212b9 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:28.937615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0226-97f8-4fd8-b224-885f508212b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:28.964986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6fda0226-97f8-4fd8-b224-885f508212b9 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:28.966637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6fda0226-97f8-4fd8-b224-885f508212b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:29.078700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1193/2344] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:29.087448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce0fe7-949c-4279-9182-ec8964ab0faf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.088205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce0fe7-949c-4279-9182-ec8964ab0faf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.088865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce0fe7-949c-4279-9182-ec8964ab0faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.114142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-00ce0fe7-949c-4279-9182-ec8964ab0faf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:29.115696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-00ce0fe7-949c-4279-9182-ec8964ab0faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:29.131422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1152/2345] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:29.135653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda0226-97f8-4fd8-b224-885f508212b9 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.140647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:29.150146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda0226-97f8-4fd8-b224-885f508212b9 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.155698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.156298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.156570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.156835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.157476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:29.157796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:29.159559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:29.174244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1194/2346] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:29.178757 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce0fe7-949c-4279-9182-ec8964ab0faf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.190078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce0fe7-949c-4279-9182-ec8964ab0faf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.195875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.196593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.197120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.197540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.198273 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:29.200369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:29.239434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1153/2347] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:29 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:29.243436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.267121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97c922-422a-40a9-a3a8-96e64663164f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.466517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.468060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.478047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.478241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.479192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:29.481089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:29.528834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1195/2348] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:29 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:29.531704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.549253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ddb8-0555-48e2-8922-719e3ee6cb35 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.554824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.555494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.555700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.555977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.556618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:29.558366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:29.586016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1154/2349] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:29.586211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.599015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9898b4-b5cf-4054-9002-12b6aa9c0f68 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.607049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c57bda-193a-4d51-ad02-a92342e11320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.607773 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c57bda-193a-4d51-ad02-a92342e11320 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.608064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c57bda-193a-4d51-ad02-a92342e11320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.608461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c57bda-193a-4d51-ad02-a92342e11320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.609452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c57bda-193a-4d51-ad02-a92342e11320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:29.610931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c57bda-193a-4d51-ad02-a92342e11320 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:29.623761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1196/2350] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:29.628070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:29.653627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc7b21-0ba5-41f0-b4f8-fcc9b9ba8449 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:29.659242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:29.660843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.660843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.660843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] PATH_INFO: `/v3/projects/07975f68db6c45f98865cdf8511d2dcf/users/cfe8939ae5d94ba9a0883b87022334ba/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.715575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07975f68db6c45f98865cdf8511d2dcf, user_id=cfe8939ae5d94ba9a0883b87022334ba, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:29.724558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:29.814148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1155/2351] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:29 2022] PUT /identity/v3/projects/07975f68db6c45f98865cdf8511d2dcf/users/cfe8939ae5d94ba9a0883b87022334ba/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:29.821408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:29.821878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:29.822309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:29.902608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:29.903840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:30.098454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1197/2352] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:30.112897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:30.116538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:30.233503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:30.269184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583da9d-6fa5-4337-9557-9fea4808268d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:30.277433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faf305-4589-4b1f-94b3-77c10ca53eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:30.278087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf305-4589-4b1f-94b3-77c10ca53eaa service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:30.278365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf305-4589-4b1f-94b3-77c10ca53eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:30.278633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faf305-4589-4b1f-94b3-77c10ca53eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:30.322874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf305-4589-4b1f-94b3-77c10ca53eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:30.324319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faf305-4589-4b1f-94b3-77c10ca53eaa service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:30.360608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1156/2353] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:30.537122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:30.538659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:30.563291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f4ee-ac6e-4f27-9f57-0fec2fe5dda5 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:30.593545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:30.602158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:30.604097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:30.604725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] PATH_INFO: `/v3/users/613b6c65815e45a9aad98d69e1054c31` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:30.608311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=613b6c65815e45a9aad98d69e1054c31)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:30.610711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:30.776308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613b6c65815e45a9aad98d69e1054c31'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:30.777070 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613b6c65815e45a9aad98d69e1054c31'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:30.811193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:30.816471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613b6c65815e45a9aad98d69e1054c31'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:30.845091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613b6c65815e45a9aad98d69e1054c31'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:30.847782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613b6c65815e45a9aad98d69e1054c31'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:30.902138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1198/2354] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:30 2022] DELETE /identity/v3/users/613b6c65815e45a9aad98d69e1054c31 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:30.906423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4296d-16aa-4e60-80f3-330990e44d49 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:30.907258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4296d-16aa-4e60-80f3-330990e44d49 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:30.907615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4296d-16aa-4e60-80f3-330990e44d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:30.957390 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-4de4296d-16aa-4e60-80f3-330990e44d49 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:30.959153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4de4296d-16aa-4e60-80f3-330990e44d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:31.059066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1157/2355] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:31.069546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:31.073075 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:31.405762 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da78e-7be8-4b77-b785-4960fa25d720 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:31.422433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:31.424639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:31.425400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:31.441185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:31.490877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:31.493890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:31.539311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1199/2356] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:32.143841 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:32.144395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:32.144395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:32.248982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] MFA Rules not processed for user `cfe8939ae5d94ba9a0883b87022334ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:32.250528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:32.449472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1158/2357] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:32.464461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:32.466490 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:32.691237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38440aea-00d8-4f54-a14c-5bcb03a1ce8b service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:32.746563 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d538df-1b08-4177-b53c-ab4ed6dae711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:32.747649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d538df-1b08-4177-b53c-ab4ed6dae711 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:32.748124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d538df-1b08-4177-b53c-ab4ed6dae711 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:32.749366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d538df-1b08-4177-b53c-ab4ed6dae711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:32.771716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d538df-1b08-4177-b53c-ab4ed6dae711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:32.773871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d538df-1b08-4177-b53c-ab4ed6dae711 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:32.821226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1200/2358] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:33.189313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:33.191118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:33.222192 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3ced9-5312-4066-b7e6-a431b1adc488 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:33.230739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:33.233187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:33.233955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:33.234852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] PATH_INFO: `/v3/projects/472bec25a6b84f67bdf8e03422947918` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:33.237744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=472bec25a6b84f67bdf8e03422947918)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:33.241834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:33.387639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472bec25a6b84f67bdf8e03422947918', 'request_id': 'req-13912384-849c-4a1c-9af8-c74f12327bfd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:33.424984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472bec25a6b84f67bdf8e03422947918', 'request_id': 'req-13912384-849c-4a1c-9af8-c74f12327bfd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:33.438690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472bec25a6b84f67bdf8e03422947918', 'request_id': 'req-13912384-849c-4a1c-9af8-c74f12327bfd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:33.443098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:33.476254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] The token cache is being invalidate because project 472bec25a6b84f67bdf8e03422947918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:33.476876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:33.477778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-13912384-849c-4a1c-9af8-c74f12327bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:33.480141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1159/2359] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:33 2022] DELETE /identity/v3/projects/472bec25a6b84f67bdf8e03422947918 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:33.967811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a7f0c-cd96-4ca6-a933-efa04bf1be3b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:33.968299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a7f0c-cd96-4ca6-a933-efa04bf1be3b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:33.968523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a7f0c-cd96-4ca6-a933-efa04bf1be3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:33.992933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-096a7f0c-cd96-4ca6-a933-efa04bf1be3b None None] MFA Rules not processed for user `c60d759f7d43411c91d2f18867654356`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:33.994273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-096a7f0c-cd96-4ca6-a933-efa04bf1be3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:34.059899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1201/2360] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:34.603875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666936-7d08-4c4c-845b-1c71166e91f4 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:34.604621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666936-7d08-4c4c-845b-1c71166e91f4 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:34.605044 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666936-7d08-4c4c-845b-1c71166e91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:34.627198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a5666936-7d08-4c4c-845b-1c71166e91f4 None None] MFA Rules not processed for user `cfe8939ae5d94ba9a0883b87022334ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:34.628652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a5666936-7d08-4c4c-845b-1c71166e91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:34.742250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1160/2361] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:36.335778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.336252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.336335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.375509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] MFA Rules not processed for user `84b2d70a23184c79883b0547d296afc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:36.377066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:36.410800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:36.448821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1202/2362] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:37.819744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab0b25-f7d5-4e41-a09b-f8c16c66a74f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:37.820398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab0b25-f7d5-4e41-a09b-f8c16c66a74f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:37.820398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab0b25-f7d5-4e41-a09b-f8c16c66a74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:37.856048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b3ab0b25-f7d5-4e41-a09b-f8c16c66a74f None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:37.859274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b3ab0b25-f7d5-4e41-a09b-f8c16c66a74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:37.984169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1161/2363] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:18:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:38.009045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:38.010857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:38.116907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c56ea-98f4-4fc1-9196-f688d797e79f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:38.122531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:38.123214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:38.123558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:38.123899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:38.134674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:38.136859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:38.148201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1203/2364] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:18:47.976124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=52 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:48.143318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=43 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:02.264285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:02.265161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:02.265617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:02.286525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:02.287638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:02.295172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1162/2365] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:19:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:02.310753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:02.322779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18d2cb-11cd-48a6-a18b-31fc7d0f3eeb service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:02.342501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad319dd1-f4ca-4673-b5f9-e4c4a6e44c39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:02.343212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319dd1-f4ca-4673-b5f9-e4c4a6e44c39 service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:02.343403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319dd1-f4ca-4673-b5f9-e4c4a6e44c39 service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:02.343641 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319dd1-f4ca-4673-b5f9-e4c4a6e44c39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:02.360146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad319dd1-f4ca-4673-b5f9-e4c4a6e44c39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:02.363683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad319dd1-f4ca-4673-b5f9-e4c4a6e44c39 service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:02.382612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1204/2366] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:19:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:10.816501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:10.819442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:10.917429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e955c-20dd-49fa-872d-175545e15c2f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:10.922522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:10.923381 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:10.923835 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:10.924269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:10.927377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:11.015178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:11.017097 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:11.054634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1163/2367] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:12.369890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:21.032815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=53 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:28.931727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:28.932827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:28.932929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:28.952611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:28.953908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:28.961248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1205/2368] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 30 04:19:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:28.974083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:28.986491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cdce8-47e7-4b18-808e-17663eb02f1a service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:28.991394 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:28.991996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:28.992275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:28.992539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:29.001124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:29.002712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:29.011284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1164/2369] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:19:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:30.981933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:30.983411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:31.060992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293c3f0-53c8-4e54-a1ac-c6077c76606c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.067214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.067919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.068195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.068468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] PATH_INFO: `/v3/users/46ed5291cafb4e01aabc11a6772eb59d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.069912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ed5291cafb4e01aabc11a6772eb59d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.073196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.119611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ed5291cafb4e01aabc11a6772eb59d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.120334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ed5291cafb4e01aabc11a6772eb59d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.133024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ed5291cafb4e01aabc11a6772eb59d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.140386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ed5291cafb4e01aabc11a6772eb59d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.141049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7e3ec130-4f04-4fdf-94b7-9814c6c26555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ed5291cafb4e01aabc11a6772eb59d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.154559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1206/2370] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:19:30 2022] DELETE /identity/v3/users/46ed5291cafb4e01aabc11a6772eb59d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:31.321197 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.333458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaa7af-733e-4cc2-8d17-2cf45e0018f7 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.394086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.394704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.394980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.395249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] PATH_INFO: `/v3/projects/33fa8472a5654c038d6ea82ed8a2153b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.396354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fa8472a5654c038d6ea82ed8a2153b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.398266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.442550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fa8472a5654c038d6ea82ed8a2153b', 'request_id': 'req-1232520e-6270-44e1-ab33-3ff1292802cc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.450009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fa8472a5654c038d6ea82ed8a2153b', 'request_id': 'req-1232520e-6270-44e1-ab33-3ff1292802cc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.455360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fa8472a5654c038d6ea82ed8a2153b', 'request_id': 'req-1232520e-6270-44e1-ab33-3ff1292802cc'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.466237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] The token cache is being invalidate because project 33fa8472a5654c038d6ea82ed8a2153b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:19:31.466520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.467140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-1232520e-6270-44e1-ab33-3ff1292802cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:31.468587 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1165/2371] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:31 2022] DELETE /identity/v3/projects/33fa8472a5654c038d6ea82ed8a2153b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:31.474087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078cea7-0488-4ccf-b06b-265872953a0f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.474375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078cea7-0488-4ccf-b06b-265872953a0f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.474654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078cea7-0488-4ccf-b06b-265872953a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.495436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3078cea7-0488-4ccf-b06b-265872953a0f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:31.496647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3078cea7-0488-4ccf-b06b-265872953a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:31.559734 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1207/2372] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:31.567514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe177a1e-f1fd-4bb7-9af8-5ece7cd44d42 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.567876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe177a1e-f1fd-4bb7-9af8-5ece7cd44d42 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.568200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe177a1e-f1fd-4bb7-9af8-5ece7cd44d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.591652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fe177a1e-f1fd-4bb7-9af8-5ece7cd44d42 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:31.592957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fe177a1e-f1fd-4bb7-9af8-5ece7cd44d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:31.602838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1166/2373] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:31.607139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078cea7-0488-4ccf-b06b-265872953a0f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.616835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078cea7-0488-4ccf-b06b-265872953a0f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.621927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.622525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.622799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.623065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.623695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:19:31.623990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.625574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.634424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:31.638944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1208/2374] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:19:31.643391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe177a1e-f1fd-4bb7-9af8-5ece7cd44d42 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.652960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe177a1e-f1fd-4bb7-9af8-5ece7cd44d42 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.658572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.659252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.659540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.659868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.660499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.662529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.691499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1167/2375] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:19:31 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:31.695572 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.706257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f3641-f4c3-4171-bc20-49ca9ba34f99 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.764271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.764874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.765152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.765421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.766141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.768023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.793356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1209/2376] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:19:31 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:31.797411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.808439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc838d-ec80-4529-8720-416291c71b8a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.813132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.813767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.814048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.814317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.814954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.816537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.826858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1168/2377] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:19:31.830756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.841316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4db1d2-da73-420c-8978-4f4eda32b3f6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.846071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9f57-a083-4cf4-b529-50e871658488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.846747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9f57-a083-4cf4-b529-50e871658488 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.846935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9f57-a083-4cf4-b529-50e871658488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.847204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9f57-a083-4cf4-b529-50e871658488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.847845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9f57-a083-4cf4-b529-50e871658488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.849401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9f57-a083-4cf4-b529-50e871658488 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.860856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1210/2378] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:19:31.864994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.876400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328418-8016-46c6-990a-ce0544c1be3f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.881104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.881874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.882140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.882447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] PATH_INFO: `/v3/projects/7a2a5bf3d42b4c1c9dba95eff86ed40b/users/b2a845fc9de048c1b1f37f3b650eb90e/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.899352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2a5bf3d42b4c1c9dba95eff86ed40b, user_id=b2a845fc9de048c1b1f37f3b650eb90e, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.902167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.915185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1169/2379] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:19:31 2022] PUT /identity/v3/projects/7a2a5bf3d42b4c1c9dba95eff86ed40b/users/b2a845fc9de048c1b1f37f3b650eb90e/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:31.926690 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b3d6-bdcb-44fc-8f0f-ecef3b66038b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.926977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b3d6-bdcb-44fc-8f0f-ecef3b66038b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.927252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b3d6-bdcb-44fc-8f0f-ecef3b66038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.956662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-b088b3d6-bdcb-44fc-8f0f-ecef3b66038b None None] MFA Rules not processed for user `b2a845fc9de048c1b1f37f3b650eb90e`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:31.957846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b088b3d6-bdcb-44fc-8f0f-ecef3b66038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:32.028066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1211/2380] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:32.039891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:32.042118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:32.055984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:32.100363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2958d9-828c-4347-9b03-88f6bf9fc63c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:32.104734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5571af9-b3b8-4c52-8349-4aeb07743d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:32.105653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5571af9-b3b8-4c52-8349-4aeb07743d68 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:32.105653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5571af9-b3b8-4c52-8349-4aeb07743d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:32.105886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5571af9-b3b8-4c52-8349-4aeb07743d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:32.114303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5571af9-b3b8-4c52-8349-4aeb07743d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:32.115739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5571af9-b3b8-4c52-8349-4aeb07743d68 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:32.125499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1170/2381] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:32.152097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b3d6-bdcb-44fc-8f0f-ecef3b66038b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:32.214214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b3d6-bdcb-44fc-8f0f-ecef3b66038b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:32.218700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:32.219332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:32.219660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:32.219928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] PATH_INFO: `/v3/users/b2a845fc9de048c1b1f37f3b650eb90e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:32.221032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a845fc9de048c1b1f37f3b650eb90e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:32.222968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:32.233856 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:32.268079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a845fc9de048c1b1f37f3b650eb90e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.268781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a845fc9de048c1b1f37f3b650eb90e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.280815 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a845fc9de048c1b1f37f3b650eb90e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.287548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a845fc9de048c1b1f37f3b650eb90e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.288205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5c5a1b9-fa37-4dee-9231-c27555c6b143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a845fc9de048c1b1f37f3b650eb90e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.300532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1212/2382] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:19:32 2022] DELETE /identity/v3/users/b2a845fc9de048c1b1f37f3b650eb90e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:32.305180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:32.305465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:32.305805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:32.324347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:32.325576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:32.376344 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:32.376631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:32.376901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:32.384708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1171/2383] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:32.394297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:32.395662 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:32.397063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:32.398269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:32.406586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1213/2384] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:32.434832 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:32.437080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:32.454265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1b981-9ce4-4b1e-8b1d-15a2afb9dc3a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:32.457950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:32.459021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:32.459155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:32.459320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:32.468775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:32.470157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:32.480214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1172/2385] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:19:32.510666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e2d7-a263-402a-9ae6-a8f2df40f583 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:32.516610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c00f9-c638-445c-a1d9-38759f953bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:32.517049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c00f9-c638-445c-a1d9-38759f953bae service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:32.517327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c00f9-c638-445c-a1d9-38759f953bae service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:32.517630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c00f9-c638-445c-a1d9-38759f953bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:32.526811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c00f9-c638-445c-a1d9-38759f953bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:32.528518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c00f9-c638-445c-a1d9-38759f953bae service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:32.539020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1214/2386] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:19:32.757216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:32.758740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:32.772441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e799ea-5c79-431f-9894-ad57c46ebf90 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:32.778033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:32.778663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:32.778945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:32.779219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] PATH_INFO: `/v3/projects/7a2a5bf3d42b4c1c9dba95eff86ed40b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:32.780395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2a5bf3d42b4c1c9dba95eff86ed40b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:32.782341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:32.827938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2a5bf3d42b4c1c9dba95eff86ed40b', 'request_id': 'req-baede5c6-53e5-43e9-960b-8a33e2b31d9e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.832056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:32.836769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2a5bf3d42b4c1c9dba95eff86ed40b', 'request_id': 'req-baede5c6-53e5-43e9-960b-8a33e2b31d9e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.844476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2a5bf3d42b4c1c9dba95eff86ed40b', 'request_id': 'req-baede5c6-53e5-43e9-960b-8a33e2b31d9e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.855429 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] The token cache is being invalidate because project 7a2a5bf3d42b4c1c9dba95eff86ed40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:19:32.855717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.856377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:32.857928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1173/2387] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:32 2022] DELETE /identity/v3/projects/7a2a5bf3d42b4c1c9dba95eff86ed40b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:35.377037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dccdb-e51c-47b0-addc-fb2cc425be3f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:35.377582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dccdb-e51c-47b0-addc-fb2cc425be3f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:35.377704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dccdb-e51c-47b0-addc-fb2cc425be3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:35.397125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a79dccdb-e51c-47b0-addc-fb2cc425be3f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:35.398368 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a79dccdb-e51c-47b0-addc-fb2cc425be3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:35.460406 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1215/2388] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:35.481434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:35.482836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:35.553524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baede5c6-53e5-43e9-960b-8a33e2b31d9e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:35.558879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:35.559470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:35.559744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:35.560012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:35.567856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:35.569408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:35.578998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1174/2389] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:39.654106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0a6e-cbb4-435a-8aa1-61c6437f9c85 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:39.654586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0a6e-cbb4-435a-8aa1-61c6437f9c85 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:39.654712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf0a6e-cbb4-435a-8aa1-61c6437f9c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:39.668939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:39.675523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cfdf0a6e-cbb4-435a-8aa1-61c6437f9c85 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:39.677557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cfdf0a6e-cbb4-435a-8aa1-61c6437f9c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:39.686129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1216/2390] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:39.711039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:39.712482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:39.728950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a42a2f-eed9-4177-8854-a1df01079d22 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:39.734637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:39.735249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:39.735491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:39.736733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:39.746990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:39.748624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:39.758178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1175/2391] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:42.742718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962bd5-cdff-40d5-8197-e2a6853b4348 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:42.743157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962bd5-cdff-40d5-8197-e2a6853b4348 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:42.743357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962bd5-cdff-40d5-8197-e2a6853b4348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:42.763433 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-81962bd5-cdff-40d5-8197-e2a6853b4348 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:42.764639 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-81962bd5-cdff-40d5-8197-e2a6853b4348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:42.772516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1217/2392] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:42.796546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:42.807543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77676fe9-afe8-4398-812a-4a3fc4357510 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:42.813033 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:42.813703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:42.813981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:42.814247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:42.822150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:42.823694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:42.832972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1176/2393] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:46.927747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33410-6a31-4589-9c9d-2ad33974e83b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:46.928229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33410-6a31-4589-9c9d-2ad33974e83b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:46.928393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33410-6a31-4589-9c9d-2ad33974e83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:46.947976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a4b33410-6a31-4589-9c9d-2ad33974e83b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:46.949150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a4b33410-6a31-4589-9c9d-2ad33974e83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:46.957372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1218/2394] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:46.982472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:46.993357 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09a818-5408-4414-a49e-c43ac3e32a02 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:46.998810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:46.999395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:46.999672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:46.999942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:47.007896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:47.009452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:47.019169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1177/2395] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:51.120728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba077b-27b6-4384-9f12-f56a17865dc6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:51.121996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba077b-27b6-4384-9f12-f56a17865dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:51.122311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba077b-27b6-4384-9f12-f56a17865dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:51.144709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-afba077b-27b6-4384-9f12-f56a17865dc6 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:51.145946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-afba077b-27b6-4384-9f12-f56a17865dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:51.154043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1219/2396] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:51.186665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:51.197735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab82b7-1446-4f08-bbdd-3ff3ba2966bd service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:51.203292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9970526-dda3-47d5-a4cf-d17f77d5481b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:51.203879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970526-dda3-47d5-a4cf-d17f77d5481b service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:51.204158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970526-dda3-47d5-a4cf-d17f77d5481b service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:51.204432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9970526-dda3-47d5-a4cf-d17f77d5481b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:51.212639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9970526-dda3-47d5-a4cf-d17f77d5481b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:51.214243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9970526-dda3-47d5-a4cf-d17f77d5481b service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:51.223506 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1178/2397] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:01.139522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=9 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:01.219374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=64,keystone:DELETE=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:05.574348 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f386-85ed-4ad4-8186-b22a6b545b5c None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:05.574851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f386-85ed-4ad4-8186-b22a6b545b5c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:05.574967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f386-85ed-4ad4-8186-b22a6b545b5c None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:05.576257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1220/2398] 10.222.0.69 () {54 vars in 961 bytes} [Tue Aug 30 04:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:05.581366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81cceb-133c-4f70-a26a-d0a8aac8443b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:05.581883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81cceb-133c-4f70-a26a-d0a8aac8443b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:05.581989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81cceb-133c-4f70-a26a-d0a8aac8443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:05.603293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0e81cceb-133c-4f70-a26a-d0a8aac8443b None None] MFA Rules not processed for user `18dabb17584f42bab408c14ef0b93858`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:05.604514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0e81cceb-133c-4f70-a26a-d0a8aac8443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:05.670610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1179/2399] 10.222.0.69 () {58 vars in 1058 bytes} [Tue Aug 30 04:20:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:05.678655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f386-85ed-4ad4-8186-b22a6b545b5c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:05.694106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f386-85ed-4ad4-8186-b22a6b545b5c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:05.700349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25268f-d33e-4eca-a821-608d164a6c5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:05.701296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25268f-d33e-4eca-a821-608d164a6c5c service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:05.701600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25268f-d33e-4eca-a821-608d164a6c5c service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:05.702046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25268f-d33e-4eca-a821-608d164a6c5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:05.703962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5f25268f-d33e-4eca-a821-608d164a6c5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:05.717922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25268f-d33e-4eca-a821-608d164a6c5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:05.719535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25268f-d33e-4eca-a821-608d164a6c5c service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:05.730339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1221/2400] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:11.472230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80f175-163d-47a2-9a52-a6d99c31ba94 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:11.472687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80f175-163d-47a2-9a52-a6d99c31ba94 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:11.472687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80f175-163d-47a2-9a52-a6d99c31ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:11.490973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-9a80f175-163d-47a2-9a52-a6d99c31ba94 None None] MFA Rules not processed for user `cfe8939ae5d94ba9a0883b87022334ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:11.492154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9a80f175-163d-47a2-9a52-a6d99c31ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:11.545054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1180/2401] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:15.725424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:17.900478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49c709-9681-461c-aa8f-a0faa14e7aaa None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:17.901134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49c709-9681-461c-aa8f-a0faa14e7aaa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:17.901134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49c709-9681-461c-aa8f-a0faa14e7aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:17.919543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fe49c709-9681-461c-aa8f-a0faa14e7aaa None None] MFA Rules not processed for user `6d217e30149d4b51817d3770c80f81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:17.920738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fe49c709-9681-461c-aa8f-a0faa14e7aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:17.976222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1222/2402] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:21.538629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=54 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:27.969397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=25 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:29.510086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47a15-cabc-473e-a905-a52cdb20ea0a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:29.510668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47a15-cabc-473e-a905-a52cdb20ea0a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:29.510668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad47a15-cabc-473e-a905-a52cdb20ea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:29.530169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bad47a15-cabc-473e-a905-a52cdb20ea0a None None] MFA Rules not processed for user `84b2d70a23184c79883b0547d296afc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:29.531361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bad47a15-cabc-473e-a905-a52cdb20ea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:29.584238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1181/2403] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:20:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:31.187149 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42e24c-6410-49f0-baf7-782676306fb5 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:31.187678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42e24c-6410-49f0-baf7-782676306fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:31.187678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42e24c-6410-49f0-baf7-782676306fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:31.207951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5b42e24c-6410-49f0-baf7-782676306fb5 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:31.209144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5b42e24c-6410-49f0-baf7-782676306fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:31.217269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1223/2404] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:31.241880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad47a15-cabc-473e-a905-a52cdb20ea0a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:31.255187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad47a15-cabc-473e-a905-a52cdb20ea0a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:31.260595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:31.261181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:31.261460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:31.261762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:31.269830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:31.271386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:31.281081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1182/2405] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:35.462787 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e7873-3735-4d96-aa13-212dcb19e2dc None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:35.463624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e7873-3735-4d96-aa13-212dcb19e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:35.463624 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e7873-3735-4d96-aa13-212dcb19e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:35.483158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-cf3e7873-3735-4d96-aa13-212dcb19e2dc None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:35.484387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cf3e7873-3735-4d96-aa13-212dcb19e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:35.492141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1224/2406] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:35.533282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:35.544194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929c74-39f0-4cda-a84b-41c26758b46d service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:35.549633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:35.550240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:35.550516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:35.550784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:35.558770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:35.560321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:35.569531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1183/2407] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:40.621643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af180a-1ae2-42fb-90fa-a560b888f7c1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:40.622265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af180a-1ae2-42fb-90fa-a560b888f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:40.622265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af180a-1ae2-42fb-90fa-a560b888f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:40.643252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f0af180a-1ae2-42fb-90fa-a560b888f7c1 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:40.644493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f0af180a-1ae2-42fb-90fa-a560b888f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:40.652615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1225/2408] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:40.676939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:40.689978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920fe0-164b-41b9-b208-0dbba419e62c service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:40.696189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:40.696900 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:40.697534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:40.697880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:40.707364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:40.709363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:40.720597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1184/2409] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:43.766161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93dbb-3c41-4a9d-8b53-a704d7b7e23b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.766630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93dbb-3c41-4a9d-8b53-a704d7b7e23b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.766742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb93dbb-3c41-4a9d-8b53-a704d7b7e23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.786521 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6cb93dbb-3c41-4a9d-8b53-a704d7b7e23b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:43.787694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6cb93dbb-3c41-4a9d-8b53-a704d7b7e23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:43.795581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1226/2410] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:43.822642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:43.834482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175f967-a578-402c-9f72-a82d839b6253 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:43.840165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:43.840744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.841080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.841534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.850330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:43.851883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:43.861226 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1185/2411] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:46.954661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916f8a-ca6b-4ed9-aa07-58ac8f89b2aa None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.955141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916f8a-ca6b-4ed9-aa07-58ac8f89b2aa None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.955233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916f8a-ca6b-4ed9-aa07-58ac8f89b2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.974960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-5b916f8a-ca6b-4ed9-aa07-58ac8f89b2aa None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:46.976139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-5b916f8a-ca6b-4ed9-aa07-58ac8f89b2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:46.983817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1227/2412] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 30 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:47.017236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.028351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d32a0-80d5-4103-8319-44ab198b0dcc service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.033915 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.034500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.034777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.035046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.043055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.044620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:47.053978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1186/2413] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:56.969805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=15 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:57.049822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=55 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:05.173933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddf92-2969-4645-9d6f-40c04023eead None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:05.174453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddf92-2969-4645-9d6f-40c04023eead None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:05.174453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddf92-2969-4645-9d6f-40c04023eead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:05.193336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7e2ddf92-2969-4645-9d6f-40c04023eead None None] MFA Rules not processed for user `9126f92a547843a99862ae046c8d303a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:05.194613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7e2ddf92-2969-4645-9d6f-40c04023eead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:05.254250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1228/2414] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:21:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:15.247299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=25 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:18.854328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:18.855819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:18.868595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4a679-27e5-4306-bbb2-646ee516461a service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:18.873119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:18.873770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:18.874046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:18.874312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] PATH_INFO: `/v3/users/cfe8939ae5d94ba9a0883b87022334ba` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:18.875487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe8939ae5d94ba9a0883b87022334ba)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:18.877376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:18.933001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe8939ae5d94ba9a0883b87022334ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:18.933713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe8939ae5d94ba9a0883b87022334ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:18.941019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe8939ae5d94ba9a0883b87022334ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:18.949027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe8939ae5d94ba9a0883b87022334ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:18.949752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7cb02539-60c0-4b9e-a393-81d1367c4a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe8939ae5d94ba9a0883b87022334ba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:18.968162 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1187/2415] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:18 2022] DELETE /identity/v3/users/cfe8939ae5d94ba9a0883b87022334ba => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:19.146453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ddf92-2969-4645-9d6f-40c04023eead None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:19.160059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ddf92-2969-4645-9d6f-40c04023eead None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:19.228289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:19.229370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:19.229674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:19.229993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] PATH_INFO: `/v3/projects/07975f68db6c45f98865cdf8511d2dcf` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:19.231164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07975f68db6c45f98865cdf8511d2dcf)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:19.233214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:19.294022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07975f68db6c45f98865cdf8511d2dcf', 'request_id': 'req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:19.301754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07975f68db6c45f98865cdf8511d2dcf', 'request_id': 'req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:19.311195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07975f68db6c45f98865cdf8511d2dcf', 'request_id': 'req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:19.324790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] The token cache is being invalidate because project 07975f68db6c45f98865cdf8511d2dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:19.325041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:19.325757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:19.327851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1229/2416] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:19 2022] DELETE /identity/v3/projects/07975f68db6c45f98865cdf8511d2dcf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:19.571102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:19.571391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:19.571664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:19.599000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:19.600293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:19.668646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1188/2417] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 30 04:21:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:19.733024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:19.735254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:19.809737 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad63b2-8307-4cae-9a73-c2ef222bf4e4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:19.815902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:19.816612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:19.816980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:19.817293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:19.825884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:19.827446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:19.836116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1230/2418] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:21:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:21:21.114228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:21.115634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:21.181438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd910e-316f-4701-b3f8-487184b3b935 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:21.185729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:21.186364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:21.186638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:21.186904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:21.189586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:21.225258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:21.278898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:21.280641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:21.292813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1189/2419] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:22.008778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:22.010277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:22.035135 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:22.091466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1ee1-9431-406b-adf5-5d9571bf487e service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:22.095827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:22.096436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:22.096714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:22.096982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:22.098788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:22.112632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:22.114094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:22.125489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1231/2420] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:27.956235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:27.961272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:28.028684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:28.030226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:28.047618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d88aea-2542-4c53-b3d4-797ba6b15e0c service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:28.057499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:28.058769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:28.059248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:28.059734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:28.062064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:28.089748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:28.091382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:28.109596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1190/2421] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:28.138423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1782b1b-6e9d-43ad-ab42-15dffe8b4f74 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:28.144922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:28.145867 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:28.146282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:28.146700 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] PATH_INFO: `/v3/users/c60d759f7d43411c91d2f18867654356` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:28.148017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60d759f7d43411c91d2f18867654356)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:28.150208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:28.226631 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60d759f7d43411c91d2f18867654356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.227425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60d759f7d43411c91d2f18867654356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.246860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60d759f7d43411c91d2f18867654356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.259340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60d759f7d43411c91d2f18867654356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.260269 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60d759f7d43411c91d2f18867654356'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.278822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1232/2422] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:28 2022] DELETE /identity/v3/users/c60d759f7d43411c91d2f18867654356 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:28.479497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:28.497043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683954c-bfa8-43f6-af73-9af143ce9d42 service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:28.569967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:28.570739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:28.571227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:28.571400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] PATH_INFO: `/v3/projects/28b66a552aba4158a6ca15dfc82c8f86` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:28.572618 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b66a552aba4158a6ca15dfc82c8f86)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:28.574634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:28.624932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b66a552aba4158a6ca15dfc82c8f86', 'request_id': 'req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.626664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:28.633777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b66a552aba4158a6ca15dfc82c8f86', 'request_id': 'req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.641571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b66a552aba4158a6ca15dfc82c8f86', 'request_id': 'req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.652736 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] The token cache is being invalidate because project 28b66a552aba4158a6ca15dfc82c8f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:28.653022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.653686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.655503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1191/2423] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:28 2022] DELETE /identity/v3/projects/28b66a552aba4158a6ca15dfc82c8f86 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:28.659934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:28.661450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:28.675573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4aa9-0b5f-4294-907d-26eab3be8c34 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:28.717189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:28.737074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:28.737743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:28.738023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:28.738295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] PATH_INFO: `/v3/users/3fbf089613504991a44efc8331f7ee4b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:28.739427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbf089613504991a44efc8331f7ee4b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:28.741342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:28.787319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbf089613504991a44efc8331f7ee4b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.787986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbf089613504991a44efc8331f7ee4b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.800486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbf089613504991a44efc8331f7ee4b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.807152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbf089613504991a44efc8331f7ee4b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.807803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-fbc4d428-ba34-4440-8ce0-83e74a07d76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbf089613504991a44efc8331f7ee4b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:28.820576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1233/2424] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:28 2022] DELETE /identity/v3/users/3fbf089613504991a44efc8331f7ee4b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:28.998400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:29.002447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:29.017838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2117b-f7f0-4e3d-b2c6-23025b08ff25 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:29.090163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:29.090681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:29.090956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:29.091234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] PATH_INFO: `/v3/projects/accc53bed50b495285c15cd21075a669` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:29.092349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] RBAC: Authorizing `identity:delete_project(project_id=accc53bed50b495285c15cd21075a669)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:29.094339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:29.146518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accc53bed50b495285c15cd21075a669', 'request_id': 'req-a42fb19a-286f-442f-978f-17306af5428c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:29.154262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accc53bed50b495285c15cd21075a669', 'request_id': 'req-a42fb19a-286f-442f-978f-17306af5428c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:29.162332 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accc53bed50b495285c15cd21075a669', 'request_id': 'req-a42fb19a-286f-442f-978f-17306af5428c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:29.174985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] The token cache is being invalidate because project accc53bed50b495285c15cd21075a669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:29.175198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:29.175839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:29.177333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1192/2425] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:28 2022] DELETE /identity/v3/projects/accc53bed50b495285c15cd21075a669 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:38.147067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:38.147625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:38.147972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:38.167884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] MFA Rules not processed for user `6d217e30149d4b51817d3770c80f81b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:38.169086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:38.227683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1234/2426] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:21:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:38.847629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:38.849191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:38.918071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fb19a-286f-442f-978f-17306af5428c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:38.923615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:38.924212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:38.924487 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:38.924754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:38.926489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:38.937689 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:38.939250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:38.943480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:38.950570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1193/2427] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:40.495880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:40.497807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:40.595150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:40.602480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d8237-f4a4-4e2a-8061-926c5a81871a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:40.612150 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:40.613051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:40.613341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:40.613788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:40.615812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:40.678249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:40.679757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:40.689828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1235/2428] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:40.739656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:40.741154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:40.800550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639549d-d821-4d47-bfa3-535121b3632d service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:40.804229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:40.804864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:40.805246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:40.805669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:40.807401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:40.874482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:40.876189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:40.889062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1194/2429] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:42.116397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:42.128297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffe90d-7311-4ece-a72d-8e260ced3574 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:42.134625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:42.135230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:42.135508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:42.135771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:42.137606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:42.149940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:42.151523 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:42.160686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1236/2430] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:45.746705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:45.748128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.761704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615cb91-ee96-4465-91ce-a8e9ad21a913 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:45.766705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:45.767285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:45.767558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:45.767821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:45.769533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.784305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:45.786052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:45.798694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1195/2431] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:45.801756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:45.803723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.817984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3d7b0-896e-4258-a9a4-1c3f1c09c388 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:45.823510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:45.824210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:45.824550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:45.824887 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] PATH_INFO: `/v3/users/84b2d70a23184c79883b0547d296afc3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:45.826101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b2d70a23184c79883b0547d296afc3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:45.829117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:45.876377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b2d70a23184c79883b0547d296afc3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.877167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b2d70a23184c79883b0547d296afc3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.889037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b2d70a23184c79883b0547d296afc3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.896488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b2d70a23184c79883b0547d296afc3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.897068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-997ab6a5-6bd8-4908-82a0-a2c936295993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b2d70a23184c79883b0547d296afc3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.910261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1237/2432] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:45 2022] DELETE /identity/v3/users/84b2d70a23184c79883b0547d296afc3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:46.095022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.119654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfd5f2-9bd5-411a-9ce1-02d26579a47a service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.190217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.191344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.191344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.191555 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] PATH_INFO: `/v3/projects/9d971e2e0cf24b5aa851e3e398a21df4` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.192494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d971e2e0cf24b5aa851e3e398a21df4)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.194485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.233114 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:46.243152 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d971e2e0cf24b5aa851e3e398a21df4', 'request_id': 'req-169d0b08-722f-473b-b57c-af7aa56949df'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:46.251031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d971e2e0cf24b5aa851e3e398a21df4', 'request_id': 'req-169d0b08-722f-473b-b57c-af7aa56949df'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:46.256572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d971e2e0cf24b5aa851e3e398a21df4', 'request_id': 'req-169d0b08-722f-473b-b57c-af7aa56949df'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:46.268254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] The token cache is being invalidate because project 9d971e2e0cf24b5aa851e3e398a21df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:46.268537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:46.269165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-169d0b08-722f-473b-b57c-af7aa56949df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:46.270675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1196/2433] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:46 2022] DELETE /identity/v3/projects/9d971e2e0cf24b5aa851e3e398a21df4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:46.275610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722e973-4396-4cec-9343-3d32e16b99b3 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.275894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722e973-4396-4cec-9343-3d32e16b99b3 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.276167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722e973-4396-4cec-9343-3d32e16b99b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.295474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8722e973-4396-4cec-9343-3d32e16b99b3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:46.296678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8722e973-4396-4cec-9343-3d32e16b99b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:46.354303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1238/2434] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:46.361993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d94e6-765c-4fa4-b78c-6c962205fbff None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.362280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d94e6-765c-4fa4-b78c-6c962205fbff None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.362553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d94e6-765c-4fa4-b78c-6c962205fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.382331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8c9d94e6-765c-4fa4-b78c-6c962205fbff None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:46.383529 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8c9d94e6-765c-4fa4-b78c-6c962205fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:46.391875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1197/2435] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:46.395863 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722e973-4396-4cec-9343-3d32e16b99b3 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.400830 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:46.407818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722e973-4396-4cec-9343-3d32e16b99b3 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.413392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.414007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.414281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.414548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.415211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:21:46.415509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.417065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.428423 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1239/2436] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:21:46.432718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d94e6-765c-4fa4-b78c-6c962205fbff None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.442467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d94e6-765c-4fa4-b78c-6c962205fbff None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.447102 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.447693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.447972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.448243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.448865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.450817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.478215 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1198/2437] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:21:46 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:46.482429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.492151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77357b-9280-4308-a6f0-4d1df4d9d04f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.546446 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.547027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.547300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.547569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.548182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.550208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.571214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1240/2438] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:21:46 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:46.575221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.586580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9db24-0f1d-4b1a-9527-805b0da804d1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.591272 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.591949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.592250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.592515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.593145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.594741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.604584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1199/2439] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:46.608576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.619115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf6dac-e76c-4b04-a910-44fc8786f3af admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.623778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeab2b-640a-4320-9fde-e22e9df7b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.624356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeab2b-640a-4320-9fde-e22e9df7b6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.624637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeab2b-640a-4320-9fde-e22e9df7b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.625536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeab2b-640a-4320-9fde-e22e9df7b6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.626236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeab2b-640a-4320-9fde-e22e9df7b6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.627802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeab2b-640a-4320-9fde-e22e9df7b6e9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.638566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1241/2440] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:46.642644 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.652435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00ce4f-27f9-4e4f-bd77-6d38bd8d01f8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.656973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.657645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.657975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.658195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] PATH_INFO: `/v3/projects/6a09fc355e634e9dab0fafed2163a943/users/54604167c97f4d828168ffc330e83ad2/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.673964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a09fc355e634e9dab0fafed2163a943, user_id=54604167c97f4d828168ffc330e83ad2, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.676609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.691250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1200/2441] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:21:46 2022] PUT /identity/v3/projects/6a09fc355e634e9dab0fafed2163a943/users/54604167c97f4d828168ffc330e83ad2/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:46.696201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.696485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.696756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.716702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:46.717941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:46.776328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1242/2442] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:46.786310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.788007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:46.842913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429abb-d133-45c3-968f-8f6ac4cb54ac admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:46.846484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74dd3-cc07-47c5-8126-a1cdb82e15e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:46.847070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74dd3-cc07-47c5-8126-a1cdb82e15e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:46.847341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74dd3-cc07-47c5-8126-a1cdb82e15e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:46.847607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74dd3-cc07-47c5-8126-a1cdb82e15e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:46.856283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74dd3-cc07-47c5-8126-a1cdb82e15e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:46.857704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74dd3-cc07-47c5-8126-a1cdb82e15e4 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:46.867252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1201/2443] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:49.591730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:49.597402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:49.610104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a47d-cb3a-434e-8666-b5395b55f639 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:49.613939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:49.614663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:49.615062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:49.615427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:49.617318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:49.628390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:49.630029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:49.639840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1243/2444] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:51.228562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae73a6-c5ba-46f1-b32d-b954b2388f8b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:51.229331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae73a6-c5ba-46f1-b32d-b954b2388f8b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:51.229646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae73a6-c5ba-46f1-b32d-b954b2388f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:51.262693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-13ae73a6-c5ba-46f1-b32d-b954b2388f8b None None] MFA Rules not processed for user `54604167c97f4d828168ffc330e83ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:51.264885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-13ae73a6-c5ba-46f1-b32d-b954b2388f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:51.353807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:51.370952 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1202/2445] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:21:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:51.385747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:51.387296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:51.447315 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:51.491268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e844e5-230f-4dc4-b901-74ecb16359fe service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:51.505353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:51.506122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:51.506465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:51.506800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:51.515277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:51.517564 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:51.526660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1244/2446] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:53.118268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:53.118782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:53.119190 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:53.142385 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] MFA Rules not processed for user `54604167c97f4d828168ffc330e83ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:53.143654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:53.152104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1203/2447] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:21:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:53.514317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:53.524109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8830f3d-9eda-42e0-84fd-81b40c550933 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:53.528056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:53.529074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:53.529074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:53.529310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:53.530908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:53.541894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:53.543319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:53.553020 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1245/2448] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:56.811760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:56.813196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:56.830115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b851-5b0e-4811-b41f-643128c69283 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:56.841799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:56.842426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:56.842700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:56.842965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:56.845234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:56.913633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:56.915249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:56.925066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1204/2449] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:03.548996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=15 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:06.920138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=34 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:08.292402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:08.307964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe510-9d00-4915-b136-5f5d06939578 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:08.317324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:08.317973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:08.318248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:08.318531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:08.320458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:08.334424 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:08.336513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:08.348848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1246/2450] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:22:12.267212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:12.281028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf267c-8b21-44b4-a2fb-6d8f66fd3d2c service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:12.288920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:12.289570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:12.289854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:12.290122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:12.291871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:12.306985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:12.308659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:12.323104 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1205/2451] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:18.170788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:18.180619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4d6bb-da8e-43e1-89b3-189f7a555438 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:18.184391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:18.185011 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:18.185294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:18.185594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:18.187415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:18.199745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:18.201131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:18.210604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1247/2452] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:21.365459 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:21.367290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:21.384070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d175a9-6895-4d5d-a7bd-c9e067009be2 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:21.391126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:21.392042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:21.392463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:21.392871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] PATH_INFO: `/v3/users/9126f92a547843a99862ae046c8d303a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:21.394619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9126f92a547843a99862ae046c8d303a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:21.397761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:21.452913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9126f92a547843a99862ae046c8d303a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.453584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9126f92a547843a99862ae046c8d303a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.460297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9126f92a547843a99862ae046c8d303a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.467617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9126f92a547843a99862ae046c8d303a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.468320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8b79ed30-cf5a-4e60-a9a8-891c09c3ac87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9126f92a547843a99862ae046c8d303a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.485933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1206/2453] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:21 2022] DELETE /identity/v3/users/9126f92a547843a99862ae046c8d303a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:21.658230 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:21.673711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5f924-1407-4040-89a5-b55e5b91679f service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:21.732087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:21.732707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:21.732982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:21.733251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] PATH_INFO: `/v3/projects/7a3a54a26d8c402a97d258a49ebf9274` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:21.734394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3a54a26d8c402a97d258a49ebf9274)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:21.736329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:21.782029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3a54a26d8c402a97d258a49ebf9274', 'request_id': 'req-a7110af2-08c2-4c32-8232-f322c5368ce6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.788978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3a54a26d8c402a97d258a49ebf9274', 'request_id': 'req-a7110af2-08c2-4c32-8232-f322c5368ce6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.797013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3a54a26d8c402a97d258a49ebf9274', 'request_id': 'req-a7110af2-08c2-4c32-8232-f322c5368ce6'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.808002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] The token cache is being invalidate because project 7a3a54a26d8c402a97d258a49ebf9274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:21.808283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.808908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a7110af2-08c2-4c32-8232-f322c5368ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:21.810400 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1248/2454] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:21 2022] DELETE /identity/v3/projects/7a3a54a26d8c402a97d258a49ebf9274 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:21.815337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b6477-6bef-44cd-b870-ad3f7a9e26d3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:21.815624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b6477-6bef-44cd-b870-ad3f7a9e26d3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:21.815891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b6477-6bef-44cd-b870-ad3f7a9e26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:21.835786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-eb5b6477-6bef-44cd-b870-ad3f7a9e26d3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:21.837247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-eb5b6477-6bef-44cd-b870-ad3f7a9e26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:21.895006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1207/2455] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:21.905105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6eeb1-a5eb-4710-84dd-b0c46638fe06 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:21.905393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6eeb1-a5eb-4710-84dd-b0c46638fe06 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:21.905699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6eeb1-a5eb-4710-84dd-b0c46638fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:21.926733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7cf6eeb1-a5eb-4710-84dd-b0c46638fe06 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:21.928131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7cf6eeb1-a5eb-4710-84dd-b0c46638fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:21.936260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1249/2456] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:21.940903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b6477-6bef-44cd-b870-ad3f7a9e26d3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:21.951825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b6477-6bef-44cd-b870-ad3f7a9e26d3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:21.956454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:21.957600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:21.957877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:21.958147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:21.958788 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:21.959090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:21.960675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:21.972286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1208/2457] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:22:21.977152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6eeb1-a5eb-4710-84dd-b0c46638fe06 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:21.986408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6eeb1-a5eb-4710-84dd-b0c46638fe06 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:21.991099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:21.991682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:21.991960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:21.992229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:21.992857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:21.994768 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.022036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1250/2458] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:21 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:22.026195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.036883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d191-3ae1-4ad9-bae7-bc16521c64de admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.080265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:22.101947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.102568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.102844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.103112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.103738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.105688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.128622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1209/2459] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:22 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:22.133054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.143358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809348-a84a-4877-aaca-073d588a6cb5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.150102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.150703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.150978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.151249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.151886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.153602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.163794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1251/2460] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:22.168064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.178079 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07120a7-530e-4217-bca6-84c0457810a4 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.182725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795822ff-3963-4eb7-bf6b-393502498c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.183338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795822ff-3963-4eb7-bf6b-393502498c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.183617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795822ff-3963-4eb7-bf6b-393502498c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.183887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795822ff-3963-4eb7-bf6b-393502498c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.184525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795822ff-3963-4eb7-bf6b-393502498c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.186284 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795822ff-3963-4eb7-bf6b-393502498c27 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.197965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1210/2461] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:22.202804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.213980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a8d7d-3a3d-470c-b463-1ec397c97bc2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.218676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.219310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.219588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.219899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] PATH_INFO: `/v3/projects/a070ae2287a542b79ec3da1c9bc5cb65/users/6d980b4e46fc4eb3b84f8812c0f0d334/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.234410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a070ae2287a542b79ec3da1c9bc5cb65, user_id=6d980b4e46fc4eb3b84f8812c0f0d334, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.237041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.245894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:22.251454 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1252/2462] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:22 2022] PUT /identity/v3/projects/a070ae2287a542b79ec3da1c9bc5cb65/users/6d980b4e46fc4eb3b84f8812c0f0d334/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:22.263475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556428d0-e32b-458f-a2f0-779aab4d118e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.263752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556428d0-e32b-458f-a2f0-779aab4d118e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.264039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556428d0-e32b-458f-a2f0-779aab4d118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.291299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-556428d0-e32b-458f-a2f0-779aab4d118e None None] MFA Rules not processed for user `6d980b4e46fc4eb3b84f8812c0f0d334`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:22.292489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-556428d0-e32b-458f-a2f0-779aab4d118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:22.355826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1211/2463] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:22.360295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.420810 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf637d4-c229-42cc-a72f-bfa2876a1f7e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.425421 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.426038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.426313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.426583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.427209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.429072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.455570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1253/2464] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:22 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:22.460252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556428d0-e32b-458f-a2f0-779aab4d118e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.471046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556428d0-e32b-458f-a2f0-779aab4d118e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.525861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.526469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.526727 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.526993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.527603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.529498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.549718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1212/2465] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:22 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:22.554076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.564254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f10290-e90d-4097-a80b-4ff57f094996 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.569668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.570252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.570528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.570798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.571427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.572992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.583598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1254/2466] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:22.588019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.598018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cf3fe-7c33-490f-8525-38db3014b656 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.602595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.603229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.603502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.603773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] PATH_INFO: `/v3/projects/9fd4fbe4b44248bd9c77870677a0bf9d/users/9df25e19c99b41aa9a146a17a3b804d5/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.618630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4fbe4b44248bd9c77870677a0bf9d, user_id=9df25e19c99b41aa9a146a17a3b804d5, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.621254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.634692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1213/2467] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:22 2022] PUT /identity/v3/projects/9fd4fbe4b44248bd9c77870677a0bf9d/users/9df25e19c99b41aa9a146a17a3b804d5/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:22:22.638666 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.648978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807140ec-fb1a-4107-8ecd-c514800a0fa1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.704630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25f989-9883-4fb9-9c7e-06d0b19deaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.705301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f989-9883-4fb9-9c7e-06d0b19deaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.705399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f989-9883-4fb9-9c7e-06d0b19deaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.705704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f989-9883-4fb9-9c7e-06d0b19deaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.706337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25f989-9883-4fb9-9c7e-06d0b19deaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.707986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25f989-9883-4fb9-9c7e-06d0b19deaa6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.717766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1255/2468] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:22.721885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.732032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c99dc-dd6a-4490-b45b-9a48ae416147 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.736604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.737276 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.738607 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.738885 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] PATH_INFO: `/v3/projects/9fd4fbe4b44248bd9c77870677a0bf9d/users/9df25e19c99b41aa9a146a17a3b804d5/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.740797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd4fbe4b44248bd9c77870677a0bf9d, user_id=9df25e19c99b41aa9a146a17a3b804d5, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.743435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.753405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1214/2469] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:22 2022] PUT /identity/v3/projects/9fd4fbe4b44248bd9c77870677a0bf9d/users/9df25e19c99b41aa9a146a17a3b804d5/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:22.763930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760e8d-5c85-4045-a6aa-0c411b757ac7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.764214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760e8d-5c85-4045-a6aa-0c411b757ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.764486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760e8d-5c85-4045-a6aa-0c411b757ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.791270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-54760e8d-5c85-4045-a6aa-0c411b757ac7 None None] MFA Rules not processed for user `9df25e19c99b41aa9a146a17a3b804d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:22.792500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-54760e8d-5c85-4045-a6aa-0c411b757ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:22.851740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:22.861342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1256/2470] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:22.872828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:22.874525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:22.884677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:22.932557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c5a2c-15f3-4592-bd91-b1d1f775ef7b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:22.936116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:22.936700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:22.936972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:22.937234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:22.945976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:22.947373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:22.956552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1215/2471] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:23.032854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54760e8d-5c85-4045-a6aa-0c411b757ac7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:23.043101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54760e8d-5c85-4045-a6aa-0c411b757ac7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:23.046881 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:23.047478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:23.047869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:23.048171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:23.103266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:23.104661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:23.113934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1257/2472] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:32.952458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=23 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:33.109357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=30 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:44.341605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:44.343189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:44.400750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784f8d8-e356-46ef-9537-598481bc6531 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:44.404972 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:44.405688 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:44.405967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:44.406233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:44.407950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:44.476260 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:44.477914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:44.488642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1216/2473] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:47.842048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:47.843841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:47.864946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b3c83-57b5-45ac-82bd-45b4b08655c2 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:47.870501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:47.871136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:47.871416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:47.871688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] PATH_INFO: `/v3/users/6d217e30149d4b51817d3770c80f81b4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:47.872884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d217e30149d4b51817d3770c80f81b4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:47.874841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:47.925493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d217e30149d4b51817d3770c80f81b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:47.926179 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d217e30149d4b51817d3770c80f81b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:47.938317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d217e30149d4b51817d3770c80f81b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:47.945106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d217e30149d4b51817d3770c80f81b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:47.945795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-194c6b2b-5680-43f2-bf83-965a139ebcb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d217e30149d4b51817d3770c80f81b4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:47.958510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1258/2474] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:47 2022] DELETE /identity/v3/users/6d217e30149d4b51817d3770c80f81b4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:22:48.142821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.164359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86be55-4a5b-4d20-b70d-60d17c3c2de5 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.231580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.232450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.232859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.233223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] PATH_INFO: `/v3/projects/e532205a456e49caa940dfb3dc3efe80` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.234533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e532205a456e49caa940dfb3dc3efe80)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.236538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.288542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e532205a456e49caa940dfb3dc3efe80', 'request_id': 'req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:48.291154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:48.297816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e532205a456e49caa940dfb3dc3efe80', 'request_id': 'req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:48.305914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e532205a456e49caa940dfb3dc3efe80', 'request_id': 'req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:48.318970 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] The token cache is being invalidate because project e532205a456e49caa940dfb3dc3efe80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:48.319772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:48.320439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-f581e282-23e8-4dd4-b0e0-c9081c6c0eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:48.321980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1217/2475] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:48 2022] DELETE /identity/v3/projects/e532205a456e49caa940dfb3dc3efe80 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:48.327152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72189-8f8c-4a8c-b8f1-4b579201c191 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.327441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72189-8f8c-4a8c-b8f1-4b579201c191 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.327776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72189-8f8c-4a8c-b8f1-4b579201c191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.350872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-39c72189-8f8c-4a8c-b8f1-4b579201c191 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:48.352141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-39c72189-8f8c-4a8c-b8f1-4b579201c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:48.419015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1259/2476] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:48.427621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578c9b6-fe87-4159-bf66-b8fd893d568c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.427908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578c9b6-fe87-4159-bf66-b8fd893d568c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.428178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578c9b6-fe87-4159-bf66-b8fd893d568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.448526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-0578c9b6-fe87-4159-bf66-b8fd893d568c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:48.449776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0578c9b6-fe87-4159-bf66-b8fd893d568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:48.457634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1218/2477] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:48.462726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72189-8f8c-4a8c-b8f1-4b579201c191 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.472239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72189-8f8c-4a8c-b8f1-4b579201c191 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.477648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.478233 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.478509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.478775 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.479422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:48.479717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.481313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.494088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1260/2478] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:22:48.498498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578c9b6-fe87-4159-bf66-b8fd893d568c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.508168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578c9b6-fe87-4159-bf66-b8fd893d568c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.512710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.513299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.513605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.513897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.514516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.516406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.545070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1219/2479] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:48.549865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.559889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc643a-9220-4a10-8d92-191a750aff90 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.615733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.616334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.616612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.616887 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.617503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.619455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.627374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:48.643492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1261/2480] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:48.648342 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.659128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3a6f-b5e8-47e9-bec4-2514f277631e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.664234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.664828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.665106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.665376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.666047 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.667624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.677395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1220/2481] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:48.681902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.691985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730b7d-69de-4e2e-854b-c92b596794a4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.696742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd07099-b264-4c8b-95ca-106c068a70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.697378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd07099-b264-4c8b-95ca-106c068a70bc admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.697712 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd07099-b264-4c8b-95ca-106c068a70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.698007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd07099-b264-4c8b-95ca-106c068a70bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.698671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd07099-b264-4c8b-95ca-106c068a70bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.700267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd07099-b264-4c8b-95ca-106c068a70bc admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.711317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1262/2482] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:48.715535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.725294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be14cb-bd02-450e-a11b-45bf27636e8a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.730558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.731235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.731512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.731807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] PATH_INFO: `/v3/projects/ae7f73d5f0464ef5886ed72c1c361243/users/1792596c86044018951b7d2d4c8af9b9/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.745962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7f73d5f0464ef5886ed72c1c361243, user_id=1792596c86044018951b7d2d4c8af9b9, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.748583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.761739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1221/2483] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:48 2022] PUT /identity/v3/projects/ae7f73d5f0464ef5886ed72c1c361243/users/1792596c86044018951b7d2d4c8af9b9/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:48.771643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce149a-9568-4863-b35c-2466a7c882c0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.771927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce149a-9568-4863-b35c-2466a7c882c0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.772194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce149a-9568-4863-b35c-2466a7c882c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.800185 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-44ce149a-9568-4863-b35c-2466a7c882c0 None None] MFA Rules not processed for user `1792596c86044018951b7d2d4c8af9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:48.801385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-44ce149a-9568-4863-b35c-2466a7c882c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:48.863292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1263/2484] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:48.868036 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.933159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ccb00-9dbc-49e8-80cc-0edb82e2ea5e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.937846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.938449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.938726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.938997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.939636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.941549 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.970849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1222/2485] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:48.974554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce149a-9568-4863-b35c-2466a7c882c0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.985885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce149a-9568-4863-b35c-2466a7c882c0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:49.047370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:49.047984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.048260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.048532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.049255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:49.051201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:49.073549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1264/2486] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:22:49.077029 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:49.087855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a5a55-eaf2-4983-a2ed-5628f84df279 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:49.092484 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:49.093083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.093359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.093671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.094314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:49.095974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:49.107581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1223/2487] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:49.113732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:49.124765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a34f5-ea6a-4001-98c9-9cd616a7206a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:49.129411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:49.130074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.130352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.130623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] PATH_INFO: `/v3/projects/9b94e84acd8a4fe28bc34f9b6a6ecb85/users/ee6bcc3f83fe4311ac15e5780c38f232/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.144933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b94e84acd8a4fe28bc34f9b6a6ecb85, user_id=ee6bcc3f83fe4311ac15e5780c38f232, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:49.147727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:49.163237 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1265/2488] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:49 2022] PUT /identity/v3/projects/9b94e84acd8a4fe28bc34f9b6a6ecb85/users/ee6bcc3f83fe4311ac15e5780c38f232/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:49.168109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:49.178089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573e9fc-2ec5-4f6b-bc70-d0f1def8d3c5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:49.224643 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:49.236609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd869274-a5f9-4be9-b7ac-84fdcf6ed05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:49.237213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869274-a5f9-4be9-b7ac-84fdcf6ed05f admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.237490 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869274-a5f9-4be9-b7ac-84fdcf6ed05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.238641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd869274-a5f9-4be9-b7ac-84fdcf6ed05f admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.238641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd869274-a5f9-4be9-b7ac-84fdcf6ed05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:49.241039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd869274-a5f9-4be9-b7ac-84fdcf6ed05f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:49.251457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1224/2489] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:49.255844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:49.266203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff2e8-5c8a-49ec-aea9-317c423fd1c8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:49.270882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:49.271463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.271741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.272014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] PATH_INFO: `/v3/projects/9b94e84acd8a4fe28bc34f9b6a6ecb85/users/ee6bcc3f83fe4311ac15e5780c38f232/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.273967 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b94e84acd8a4fe28bc34f9b6a6ecb85, user_id=ee6bcc3f83fe4311ac15e5780c38f232, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:49.276578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:49.286686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1266/2490] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:49 2022] PUT /identity/v3/projects/9b94e84acd8a4fe28bc34f9b6a6ecb85/users/ee6bcc3f83fe4311ac15e5780c38f232/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:22:49.298456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d524-aa00-4b30-8ab8-c3ccafdd3d9e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.298735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d524-aa00-4b30-8ab8-c3ccafdd3d9e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.299003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d524-aa00-4b30-8ab8-c3ccafdd3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.326943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-cf36d524-aa00-4b30-8ab8-c3ccafdd3d9e None None] MFA Rules not processed for user `ee6bcc3f83fe4311ac15e5780c38f232`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:49.328182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cf36d524-aa00-4b30-8ab8-c3ccafdd3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:49.395414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1225/2491] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:49.407167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:49.409025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:49.434817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:49.474420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1a3f-d2ac-49c1-b5df-21653d9408cd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:49.478999 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:49.479595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.480300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.480568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.489832 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:49.491236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:49.500801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1267/2492] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:49.579735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d524-aa00-4b30-8ab8-c3ccafdd3d9e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:49.591980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d524-aa00-4b30-8ab8-c3ccafdd3d9e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:49.596319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8de2b-d01e-47fb-a5dd-ccc1845a641a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:49.597083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8de2b-d01e-47fb-a5dd-ccc1845a641a service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:49.597415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8de2b-d01e-47fb-a5dd-ccc1845a641a service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:49.597833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8de2b-d01e-47fb-a5dd-ccc1845a641a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:49.658220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8de2b-d01e-47fb-a5dd-ccc1845a641a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:49.659668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8de2b-d01e-47fb-a5dd-ccc1845a641a service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:49.669728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1226/2493] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:52.476335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:52.477794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:52.553890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62482193-740e-45ab-9049-f8d1e55f7e7d service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:52.561122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:52.561905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:52.562726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:52.563006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] PATH_INFO: `/v3/users/6d980b4e46fc4eb3b84f8812c0f0d334` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:52.565302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d980b4e46fc4eb3b84f8812c0f0d334)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:52.567736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:52.639767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d980b4e46fc4eb3b84f8812c0f0d334'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:52.641217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d980b4e46fc4eb3b84f8812c0f0d334'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:52.659093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d980b4e46fc4eb3b84f8812c0f0d334'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:52.666226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d980b4e46fc4eb3b84f8812c0f0d334'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:52.666981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d980b4e46fc4eb3b84f8812c0f0d334'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:52.678938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1268/2494] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:52 2022] DELETE /identity/v3/users/6d980b4e46fc4eb3b84f8812c0f0d334 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:52.684268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:52.684758 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:52.684874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:52.704696 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:52.705926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:52.763568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1227/2495] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:52.773221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:52.774646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:52.819505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:52.832297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd028c-87ce-43b9-ae51-c6fe08f5ba73 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:52.835919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:52.836507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:52.836782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:52.837052 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:52.846321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:52.847792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:52.857735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1269/2496] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:53.121518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:53.123010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:53.135028 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120478c-6d37-46a8-9fab-4cfaeef8a0bf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:53.139880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:53.140511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:53.140788 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:53.141061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] PATH_INFO: `/v3/projects/a070ae2287a542b79ec3da1c9bc5cb65` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:53.142225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a070ae2287a542b79ec3da1c9bc5cb65)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:53.144141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:53.153568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:53.194518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a070ae2287a542b79ec3da1c9bc5cb65', 'request_id': 'req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.201706 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a070ae2287a542b79ec3da1c9bc5cb65', 'request_id': 'req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.207159 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a070ae2287a542b79ec3da1c9bc5cb65', 'request_id': 'req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.218945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] The token cache is being invalidate because project a070ae2287a542b79ec3da1c9bc5cb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:53.219231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.219862 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.221369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1228/2497] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:53 2022] DELETE /identity/v3/projects/a070ae2287a542b79ec3da1c9bc5cb65 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:53.225328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:53.235515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816d3da-a290-48cb-8e19-4670c3ad664d service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:53.292142 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:53.292766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:53.293038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:53.293304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] PATH_INFO: `/v3/users/9df25e19c99b41aa9a146a17a3b804d5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:53.294809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df25e19c99b41aa9a146a17a3b804d5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:53.296792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:53.343280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df25e19c99b41aa9a146a17a3b804d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.343927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df25e19c99b41aa9a146a17a3b804d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.355586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df25e19c99b41aa9a146a17a3b804d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.362346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df25e19c99b41aa9a146a17a3b804d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.362982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-74b80ac6-bde3-4de0-b477-67d4563e9a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df25e19c99b41aa9a146a17a3b804d5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.376789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1270/2498] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:53 2022] DELETE /identity/v3/users/9df25e19c99b41aa9a146a17a3b804d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:53.657016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:53.658493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:53.673174 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20cdc6-e2ee-4c6e-a737-cd6abe4cb44e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:53.757838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:53.759828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:53.760116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:53.760392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] PATH_INFO: `/v3/projects/9fd4fbe4b44248bd9c77870677a0bf9d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:53.761580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd4fbe4b44248bd9c77870677a0bf9d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:53.764127 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:53.830422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd4fbe4b44248bd9c77870677a0bf9d', 'request_id': 'req-7d8a6107-63ae-414a-983a-502eded4e7d0'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.844617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd4fbe4b44248bd9c77870677a0bf9d', 'request_id': 'req-7d8a6107-63ae-414a-983a-502eded4e7d0'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.855770 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd4fbe4b44248bd9c77870677a0bf9d', 'request_id': 'req-7d8a6107-63ae-414a-983a-502eded4e7d0'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.870345 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] The token cache is being invalidate because project 9fd4fbe4b44248bd9c77870677a0bf9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:53.870634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.871595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-7d8a6107-63ae-414a-983a-502eded4e7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:53.873090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1229/2499] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:53 2022] DELETE /identity/v3/projects/9fd4fbe4b44248bd9c77870677a0bf9d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:53.877962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae0e6-9f4e-4a91-b3be-50e0e8b8d046 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:53.878413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae0e6-9f4e-4a91-b3be-50e0e8b8d046 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:53.878549 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae0e6-9f4e-4a91-b3be-50e0e8b8d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:53.900361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a60ae0e6-9f4e-4a91-b3be-50e0e8b8d046 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:53.901657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a60ae0e6-9f4e-4a91-b3be-50e0e8b8d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:53.965687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1271/2500] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:53.975598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b5253-15b6-47cb-a23e-af89d37a47ac None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:53.975881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b5253-15b6-47cb-a23e-af89d37a47ac None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:53.976155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b5253-15b6-47cb-a23e-af89d37a47ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:53.997408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ce9b5253-15b6-47cb-a23e-af89d37a47ac None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:53.999380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ce9b5253-15b6-47cb-a23e-af89d37a47ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:54.008012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1230/2501] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:54.012977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae0e6-9f4e-4a91-b3be-50e0e8b8d046 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.029711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:54.029711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae0e6-9f4e-4a91-b3be-50e0e8b8d046 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.030965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.030965 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.031165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.031484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.032161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:54.032626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.034082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.046789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1272/2502] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:22:54.051380 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b5253-15b6-47cb-a23e-af89d37a47ac None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.061597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b5253-15b6-47cb-a23e-af89d37a47ac None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.066957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.067820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.068204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.068366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.069000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.071929 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.092565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:54.105942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1231/2503] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:54 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:54.110330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.120705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcd2bd-3987-4ca2-9a69-4997936b2385 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.180942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.181414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.181761 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.182056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.182726 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.184747 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.207207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1273/2504] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:54 2022] POST /identity/v3/users => generated 278 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:22:54.212004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.222493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da31e4d-1915-4c85-b7be-1a4f303ea84a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.227612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.228201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.228477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.228744 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.229368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.230973 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.240701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1232/2505] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:22:54.245005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.254957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d1ccb-5a4b-4ea1-a7c6-fe533071b6e5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.260107 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbbb2a-aa8e-4331-a047-c1c17f3e9791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.260683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbbb2a-aa8e-4331-a047-c1c17f3e9791 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.260954 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbbb2a-aa8e-4331-a047-c1c17f3e9791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.261220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbbb2a-aa8e-4331-a047-c1c17f3e9791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.261913 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbbb2a-aa8e-4331-a047-c1c17f3e9791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.263451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbbb2a-aa8e-4331-a047-c1c17f3e9791 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.273697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1274/2506] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:54.277581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.287520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b6cd6-bf6f-427b-8baa-2568b3859d3e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.292737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.293366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.293691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.293964 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] PATH_INFO: `/v3/projects/356a88f0fb564c6d926940e2fe47523b/users/eda53d190b77417ab88ccbcc670ed6c5/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.308933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=356a88f0fb564c6d926940e2fe47523b, user_id=eda53d190b77417ab88ccbcc670ed6c5, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.311666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.324451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1233/2507] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:54 2022] PUT /identity/v3/projects/356a88f0fb564c6d926940e2fe47523b/users/eda53d190b77417ab88ccbcc670ed6c5/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:54.334473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7f0cb-8ac7-45e6-9502-d7e2ce1ad841 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.334755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7f0cb-8ac7-45e6-9502-d7e2ce1ad841 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.335024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7f0cb-8ac7-45e6-9502-d7e2ce1ad841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.362220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7da7f0cb-8ac7-45e6-9502-d7e2ce1ad841 None None] MFA Rules not processed for user `eda53d190b77417ab88ccbcc670ed6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:54.363405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7da7f0cb-8ac7-45e6-9502-d7e2ce1ad841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:54.426324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1275/2508] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:54.431367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.491187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3178-b8b0-457e-a7d5-b7753b19c4fb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.496425 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.497015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.497294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.497596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.498227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.500115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.525933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1234/2509] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:54 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:54.529955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7f0cb-8ac7-45e6-9502-d7e2ce1ad841 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.540956 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7f0cb-8ac7-45e6-9502-d7e2ce1ad841 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.597399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.598033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.598311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.598580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.599204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.601108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.609544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:54.623846 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1276/2510] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:54 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:54.627829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.638126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04344536-3eee-43d1-8c29-e71501dad07d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.642648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.643243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.643516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.643786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.644415 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.646023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.656753 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1235/2511] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:54.660652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.671203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4f0a-b144-4496-bef4-1d3fa165ddae admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.675851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.676478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.676755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.677024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] PATH_INFO: `/v3/projects/c9eed868bba04308acd3ee7f94e7baf8/users/e4e73ce32e5d48b38e03184db83b1ce9/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.691552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9eed868bba04308acd3ee7f94e7baf8, user_id=e4e73ce32e5d48b38e03184db83b1ce9, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.694223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.707449 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1277/2512] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:54 2022] PUT /identity/v3/projects/c9eed868bba04308acd3ee7f94e7baf8/users/e4e73ce32e5d48b38e03184db83b1ce9/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:54.711337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.722129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc29ca4-5531-4812-9e0b-ccf81d84c6f2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.777577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafc6bd-46d6-46fe-b272-6a3b4fe39e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.778225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafc6bd-46d6-46fe-b272-6a3b4fe39e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.778532 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafc6bd-46d6-46fe-b272-6a3b4fe39e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.778802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafc6bd-46d6-46fe-b272-6a3b4fe39e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.779438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafc6bd-46d6-46fe-b272-6a3b4fe39e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.781008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafc6bd-46d6-46fe-b272-6a3b4fe39e3a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.791270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1236/2513] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:54.795385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.805620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb001774-a78b-4e13-b3cd-626fa18b9dda admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:54.810300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:54.811048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.811327 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.811598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] PATH_INFO: `/v3/projects/c9eed868bba04308acd3ee7f94e7baf8/users/e4e73ce32e5d48b38e03184db83b1ce9/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.813558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9eed868bba04308acd3ee7f94e7baf8, user_id=e4e73ce32e5d48b38e03184db83b1ce9, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:54.816155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.826053 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1278/2514] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:54 2022] PUT /identity/v3/projects/c9eed868bba04308acd3ee7f94e7baf8/users/e4e73ce32e5d48b38e03184db83b1ce9/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:54.836080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:54.836359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:54.837115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:54.864580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] MFA Rules not processed for user `e4e73ce32e5d48b38e03184db83b1ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:54.865746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:54.883987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:54.940780 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1237/2515] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:54.952126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:54.954043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:55.015169 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4d72-c305-48e9-8c46-6517959b22e9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:55.018821 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:55.019422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:55.019694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:55.019962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:55.029900 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:55.031305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:55.040741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1279/2516] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:55.116202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:55.117548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:55.129683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb9391-8240-44c0-bf35-878fd8d3da3d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:55.134246 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3cd54-9f44-4ee8-996d-0d00df38e9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:55.134878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3cd54-9f44-4ee8-996d-0d00df38e9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:55.135210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3cd54-9f44-4ee8-996d-0d00df38e9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:55.135412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3cd54-9f44-4ee8-996d-0d00df38e9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:55.197584 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3cd54-9f44-4ee8-996d-0d00df38e9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:55.199039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3cd54-9f44-4ee8-996d-0d00df38e9e5 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:55.208431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1238/2517] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:56.583539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:56.584923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:56.650544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58029680-328e-400e-9d09-af56ac4cae57 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:56.655013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:56.655632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:56.655908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:56.656180 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] PATH_INFO: `/v3/users/1792596c86044018951b7d2d4c8af9b9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:56.657282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] RBAC: Authorizing `identity:delete_user(user_id=1792596c86044018951b7d2d4c8af9b9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:56.659215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:56.705217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1792596c86044018951b7d2d4c8af9b9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.705886 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1792596c86044018951b7d2d4c8af9b9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.713442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:56.719590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1792596c86044018951b7d2d4c8af9b9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.727620 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1792596c86044018951b7d2d4c8af9b9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.728316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1792596c86044018951b7d2d4c8af9b9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.741125 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1280/2518] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:56 2022] DELETE /identity/v3/users/1792596c86044018951b7d2d4c8af9b9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:56.745851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:56.746312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:56.746410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:56.765392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:56.766630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:56.825278 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1239/2519] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:56.835087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:56.836476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:56.892890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a9289-d326-4802-877b-91fb9c60bade admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:56.896530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:56.897136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:56.897410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:56.897703 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:56.908398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:56.909851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:56.919471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1281/2520] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:57.181362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:57.182848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:57.195022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98245e-8788-4849-8d95-f916cbcd932f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:57.199632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:57.200256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.200534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.200802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] PATH_INFO: `/v3/projects/ae7f73d5f0464ef5886ed72c1c361243` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.201953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7f73d5f0464ef5886ed72c1c361243)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:57.203855 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:57.251597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7f73d5f0464ef5886ed72c1c361243', 'request_id': 'req-49ce10fd-4d60-4387-b90e-07cd67ca33f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.253296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:57.261865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7f73d5f0464ef5886ed72c1c361243', 'request_id': 'req-49ce10fd-4d60-4387-b90e-07cd67ca33f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.267807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7f73d5f0464ef5886ed72c1c361243', 'request_id': 'req-49ce10fd-4d60-4387-b90e-07cd67ca33f3'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.279596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] The token cache is being invalidate because project ae7f73d5f0464ef5886ed72c1c361243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:57.279872 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.280504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.282031 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1240/2521] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:57 2022] DELETE /identity/v3/projects/ae7f73d5f0464ef5886ed72c1c361243 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:57.285984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:57.295869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592dae5-f23f-4371-8ea6-765e8329f0e4 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:57.356283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:57.356924 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.357748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.357748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] PATH_INFO: `/v3/users/ee6bcc3f83fe4311ac15e5780c38f232` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.358591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6bcc3f83fe4311ac15e5780c38f232)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:57.360506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:57.409720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6bcc3f83fe4311ac15e5780c38f232'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.410399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6bcc3f83fe4311ac15e5780c38f232'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.422495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6bcc3f83fe4311ac15e5780c38f232'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.429302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6bcc3f83fe4311ac15e5780c38f232'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.429905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8935b591-87d4-4831-897a-0209afa66085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6bcc3f83fe4311ac15e5780c38f232'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.433489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:57.444130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1282/2522] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:57 2022] DELETE /identity/v3/users/ee6bcc3f83fe4311ac15e5780c38f232 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:22:57.723216 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:57.724951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:57.744041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce10fd-4d60-4387-b90e-07cd67ca33f3 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:57.814089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:57.815106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.815106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.815470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] PATH_INFO: `/v3/projects/9b94e84acd8a4fe28bc34f9b6a6ecb85` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.817146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b94e84acd8a4fe28bc34f9b6a6ecb85)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:57.819658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:57.873996 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b94e84acd8a4fe28bc34f9b6a6ecb85', 'request_id': 'req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.882625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b94e84acd8a4fe28bc34f9b6a6ecb85', 'request_id': 'req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.889289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b94e84acd8a4fe28bc34f9b6a6ecb85', 'request_id': 'req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.903622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] The token cache is being invalidate because project 9b94e84acd8a4fe28bc34f9b6a6ecb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:57.903920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.904628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e51fadf7-f7e9-426a-8e36-214bfe22aa4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.906730 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1241/2523] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:57 2022] DELETE /identity/v3/projects/9b94e84acd8a4fe28bc34f9b6a6ecb85 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:57.911720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303afb-c528-4353-b7a4-5c686951294a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.912213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303afb-c528-4353-b7a4-5c686951294a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.912330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303afb-c528-4353-b7a4-5c686951294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.933171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-75303afb-c528-4353-b7a4-5c686951294a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:57.934685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-75303afb-c528-4353-b7a4-5c686951294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.003373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1283/2524] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:58.011754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0f1f8-afd9-4d89-b5de-b5f70f8edfde None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.012060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0f1f8-afd9-4d89-b5de-b5f70f8edfde None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.012328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0f1f8-afd9-4d89-b5de-b5f70f8edfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.033124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f0b0f1f8-afd9-4d89-b5de-b5f70f8edfde None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:58.034254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f0b0f1f8-afd9-4d89-b5de-b5f70f8edfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.042846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1242/2525] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:58.047202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303afb-c528-4353-b7a4-5c686951294a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.057419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303afb-c528-4353-b7a4-5c686951294a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.061920 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.062506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.062779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.063051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.063683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:58.063980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.065554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.077366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1284/2526] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:22:58.081680 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0f1f8-afd9-4d89-b5de-b5f70f8edfde None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.091547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0f1f8-afd9-4d89-b5de-b5f70f8edfde None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.096171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.096761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.097029 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.097292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.097982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.099866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.128965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1243/2527] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:58.133217 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.143072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b65fb-bb5d-4774-8f6b-5788c0b89869 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.199618 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.200242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.201342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.201651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.202337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.204545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.226689 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1285/2528] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:58.231293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.241705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759745a-dfbb-4fda-8df9-41f17f96a6cb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.247180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.247779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.248057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.248356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.248995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.250664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.260550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1244/2529] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:58.264518 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.274839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43a13e-d16b-4b7f-a23c-cd892f78d161 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.280196 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a96ded-72ac-4445-a1af-6fa5178a3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.280781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96ded-72ac-4445-a1af-6fa5178a3b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.281057 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96ded-72ac-4445-a1af-6fa5178a3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.281353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96ded-72ac-4445-a1af-6fa5178a3b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.282017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a96ded-72ac-4445-a1af-6fa5178a3b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.283598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a96ded-72ac-4445-a1af-6fa5178a3b9d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.295754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1286/2530] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:58.299955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.311139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d43bc4-af19-4944-802b-00ec2087b048 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.316714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.317424 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.317734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.318016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] PATH_INFO: `/v3/projects/6d30e087181d4548bccddd4300db4076/users/9c52378213c743e581e8437ff6e77ca7/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.334062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d30e087181d4548bccddd4300db4076, user_id=9c52378213c743e581e8437ff6e77ca7, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.336782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.349755 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1245/2531] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:58 2022] PUT /identity/v3/projects/6d30e087181d4548bccddd4300db4076/users/9c52378213c743e581e8437ff6e77ca7/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:58.360559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1708-34c0-4576-ac2e-dba5948c22a7 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.360794 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1708-34c0-4576-ac2e-dba5948c22a7 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.361069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1708-34c0-4576-ac2e-dba5948c22a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.389021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8f4e1708-34c0-4576-ac2e-dba5948c22a7 None None] MFA Rules not processed for user `9c52378213c743e581e8437ff6e77ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:58.390280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8f4e1708-34c0-4576-ac2e-dba5948c22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.438102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:58.457499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1287/2532] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:58.462892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.468426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:58.527281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221ce86-b34a-4194-8445-caabe1329c38 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.532621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.533354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.533678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.533940 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.534588 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.536637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.564742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1246/2533] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:58.568810 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e1708-34c0-4576-ac2e-dba5948c22a7 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.581134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e1708-34c0-4576-ac2e-dba5948c22a7 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.639343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.639943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.640224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.640494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.641124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.643095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.664531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1288/2534] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:58.668598 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.679228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df522c9-81e4-4767-bdd3-e46906e4a6de admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.684412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.684993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.685277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.685576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.686410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.687987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.699268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1247/2535] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:58.703252 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.713452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24caca-5ddd-47ce-b422-1915f333c318 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.717973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.718598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.718875 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.719144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] PATH_INFO: `/v3/projects/76d130d52c3e48c1b61e13c2ed02c3fd/users/1e177147e20844ba94979977d65c1806/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.733492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d130d52c3e48c1b61e13c2ed02c3fd, user_id=1e177147e20844ba94979977d65c1806, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.736228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.749163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1289/2536] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:58 2022] PUT /identity/v3/projects/76d130d52c3e48c1b61e13c2ed02c3fd/users/1e177147e20844ba94979977d65c1806/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:22:58.753073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.763443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfcd5d-bae7-4bb5-a465-b0f55e4a4011 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.818545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd7414-2703-4e33-9489-1114d76fc05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.819161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7414-2703-4e33-9489-1114d76fc05c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.819398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7414-2703-4e33-9489-1114d76fc05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.819669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd7414-2703-4e33-9489-1114d76fc05c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.820293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7414-2703-4e33-9489-1114d76fc05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.821920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd7414-2703-4e33-9489-1114d76fc05c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.831458 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1248/2537] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:58.835587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.846007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4a17-f534-42de-b3de-7519ba0bfd5c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.850674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.851305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.851579 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.851849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] PATH_INFO: `/v3/projects/76d130d52c3e48c1b61e13c2ed02c3fd/users/1e177147e20844ba94979977d65c1806/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.854436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d130d52c3e48c1b61e13c2ed02c3fd, user_id=1e177147e20844ba94979977d65c1806, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.857084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.867148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1290/2538] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:58 2022] PUT /identity/v3/projects/76d130d52c3e48c1b61e13c2ed02c3fd/users/1e177147e20844ba94979977d65c1806/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:58.878845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174709-ad66-4139-b970-eaf219ebafb8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.879141 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174709-ad66-4139-b970-eaf219ebafb8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.879400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174709-ad66-4139-b970-eaf219ebafb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.906971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-51174709-ad66-4139-b970-eaf219ebafb8 None None] MFA Rules not processed for user `1e177147e20844ba94979977d65c1806`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:58.908181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-51174709-ad66-4139-b970-eaf219ebafb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.973768 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:58.982245 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1249/2539] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:58.989681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.991520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:59.052683 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba7c7-4dd3-42a3-9265-9c1c02c2de84 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:59.057330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcacc8-96ea-418f-b4b6-c0996ff7f255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:59.058098 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcacc8-96ea-418f-b4b6-c0996ff7f255 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:59.058213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcacc8-96ea-418f-b4b6-c0996ff7f255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:59.058475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcacc8-96ea-418f-b4b6-c0996ff7f255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:59.068786 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcacc8-96ea-418f-b4b6-c0996ff7f255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:59.070288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcacc8-96ea-418f-b4b6-c0996ff7f255 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:59.079955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1291/2540] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:59.468597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174709-ad66-4139-b970-eaf219ebafb8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:59.532538 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174709-ad66-4139-b970-eaf219ebafb8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:59.537205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:59.537857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:59.538151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:59.538403 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] PATH_INFO: `/v3/users/9c52378213c743e581e8437ff6e77ca7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:59.539518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c52378213c743e581e8437ff6e77ca7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:59.541958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:59.590573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c52378213c743e581e8437ff6e77ca7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:59.591316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c52378213c743e581e8437ff6e77ca7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:59.598436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c52378213c743e581e8437ff6e77ca7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:59.606597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c52378213c743e581e8437ff6e77ca7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:59.607648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c52378213c743e581e8437ff6e77ca7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:59.627489 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1250/2541] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:59 2022] DELETE /identity/v3/users/9c52378213c743e581e8437ff6e77ca7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:59.632055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:59.632341 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:59.632614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:59.652353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:59.653590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:59.700939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:59.726056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1292/2542] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:59.737300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:59.738787 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:59.800021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659112d-fe01-4adf-b275-7e111e03c0fc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:59.803843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:59.804439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:59.804714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:59.805019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:59.815195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:59.816609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:59.825985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1251/2543] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:00.087626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:00.089197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:00.109302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acd07e-d206-4c38-90ca-55c75c6b79df None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:00.113960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:00.114592 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:00.114868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:00.115304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] PATH_INFO: `/v3/projects/6d30e087181d4548bccddd4300db4076` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:00.116647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d30e087181d4548bccddd4300db4076)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:00.118569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:00.163922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d30e087181d4548bccddd4300db4076', 'request_id': 'req-dbb4c016-991d-464b-a844-5f4248823a6b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.169878 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d30e087181d4548bccddd4300db4076', 'request_id': 'req-dbb4c016-991d-464b-a844-5f4248823a6b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.177036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d30e087181d4548bccddd4300db4076', 'request_id': 'req-dbb4c016-991d-464b-a844-5f4248823a6b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.187959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] The token cache is being invalidate because project 6d30e087181d4548bccddd4300db4076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:00.188244 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.188873 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.190375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1293/2544] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:00 2022] DELETE /identity/v3/projects/6d30e087181d4548bccddd4300db4076 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:00.194395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:00.203977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7f934-660e-4386-a05b-9489b0b651d5 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:00.222630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:00.263717 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:00.264257 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:00.264530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:00.264795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] PATH_INFO: `/v3/users/1e177147e20844ba94979977d65c1806` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:00.265927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e177147e20844ba94979977d65c1806)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:00.267815 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:00.312290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e177147e20844ba94979977d65c1806'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.312928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e177147e20844ba94979977d65c1806'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.319708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e177147e20844ba94979977d65c1806'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.327356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e177147e20844ba94979977d65c1806'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.327979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-a3b1eb5c-ccee-440c-87ec-e65d5175eadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e177147e20844ba94979977d65c1806'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.345861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1252/2545] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:00 2022] DELETE /identity/v3/users/1e177147e20844ba94979977d65c1806 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:00.624082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:00.626099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:00.642235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4c016-991d-464b-a844-5f4248823a6b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:00.706835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:00.707466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:00.707741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:00.708102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] PATH_INFO: `/v3/projects/76d130d52c3e48c1b61e13c2ed02c3fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:00.709195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d130d52c3e48c1b61e13c2ed02c3fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:00.711118 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:00.755339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d130d52c3e48c1b61e13c2ed02c3fd', 'request_id': 'req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.761297 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d130d52c3e48c1b61e13c2ed02c3fd', 'request_id': 'req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.767527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d130d52c3e48c1b61e13c2ed02c3fd', 'request_id': 'req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.775012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:00.778909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] The token cache is being invalidate because project 76d130d52c3e48c1b61e13c2ed02c3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:00.779410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.780223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-a70ac7e6-c28b-49d0-80c2-2e90d43ba1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:00.782276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1294/2546] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:00 2022] DELETE /identity/v3/projects/76d130d52c3e48c1b61e13c2ed02c3fd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:00.787195 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c130ed0-5e3f-4197-afaf-e57965e2b288 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:00.787474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c130ed0-5e3f-4197-afaf-e57965e2b288 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:00.787791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c130ed0-5e3f-4197-afaf-e57965e2b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:00.807782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3c130ed0-5e3f-4197-afaf-e57965e2b288 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:00.809092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3c130ed0-5e3f-4197-afaf-e57965e2b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:00.884461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1253/2547] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:00.892397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bb357-f319-4037-819b-b6f8f0755ca4 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:00.892791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bb357-f319-4037-819b-b6f8f0755ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:00.892945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bb357-f319-4037-819b-b6f8f0755ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:00.923203 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-073bb357-f319-4037-819b-b6f8f0755ca4 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:00.924426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-073bb357-f319-4037-819b-b6f8f0755ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:00.935251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1295/2548] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:00.939320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c130ed0-5e3f-4197-afaf-e57965e2b288 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:00.951120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c130ed0-5e3f-4197-afaf-e57965e2b288 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:00.957767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:00.958478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:00.958818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:00.959265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:00.959978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:00.960343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:00.962946 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:00.980986 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1254/2549] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:00.982102 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bb357-f319-4037-819b-b6f8f0755ca4 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:00.995692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bb357-f319-4037-819b-b6f8f0755ca4 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.000274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.000865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.001133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.001397 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.002062 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.003933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.036407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1296/2550] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:00 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:01.037358 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.051006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbd323-1a76-49aa-8586-d51e15669ef9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.079833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:01.113314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.113951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.114228 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.114500 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.115118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.117049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.138129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1255/2551] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:01 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:01.142308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.153047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf9c1e-1534-43f4-b6e1-1bc378433429 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.157612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.158198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.158473 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.158742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.159372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.160935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.171625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1297/2552] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:01.175691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.186391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3447-ea9e-422b-9d08-9e16cb4d20bf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.190932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738838e-3eaa-4b23-a6cc-0a485bb9efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.191514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738838e-3eaa-4b23-a6cc-0a485bb9efdf admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.191784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738838e-3eaa-4b23-a6cc-0a485bb9efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.192050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738838e-3eaa-4b23-a6cc-0a485bb9efdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.192674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738838e-3eaa-4b23-a6cc-0a485bb9efdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.194293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738838e-3eaa-4b23-a6cc-0a485bb9efdf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.204444 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1256/2553] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:01.208491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.218653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07421d3-3556-479d-a288-ec62d30da605 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.223235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.223861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.224138 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.224407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] PATH_INFO: `/v3/projects/450a61b86daa439da8778fff14278eea/users/86c1b2838c5c4e7b9e957a2372f16768/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.238923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] RBAC: Authorizing `identity:create_grant(project_id=450a61b86daa439da8778fff14278eea, user_id=86c1b2838c5c4e7b9e957a2372f16768, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.241621 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.254704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1298/2554] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:01 2022] PUT /identity/v3/projects/450a61b86daa439da8778fff14278eea/users/86c1b2838c5c4e7b9e957a2372f16768/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:01.265013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0fb5-973b-426c-83e4-44ab2428dbf8 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.265295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0fb5-973b-426c-83e4-44ab2428dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.265590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0fb5-973b-426c-83e4-44ab2428dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.292703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-236b0fb5-973b-426c-83e4-44ab2428dbf8 None None] MFA Rules not processed for user `86c1b2838c5c4e7b9e957a2372f16768`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:01.293926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-236b0fb5-973b-426c-83e4-44ab2428dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:01.361660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1257/2555] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:01.366202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.427270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895545d8-f7d3-444c-936b-16944d1f513b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.431854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.432442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.432717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.432985 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.433638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.435503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.460679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1299/2556] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:01 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:01.465481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b0fb5-973b-426c-83e4-44ab2428dbf8 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.475898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b0fb5-973b-426c-83e4-44ab2428dbf8 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.531262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.531847 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.532124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.532393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.533005 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.534926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.556846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1258/2557] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:01 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:01.560799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.570902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9ad1-2445-48fd-a933-9bf85580248c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.575778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.576795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.577068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.577354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.578496 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.580120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.591481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1300/2558] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:01.595625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.605471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db06426-5a90-413d-afa9-c9ed03c35bb1 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.610088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.610712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.610990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.611252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] PATH_INFO: `/v3/projects/56ec40f81a0b422998f0364159352ac6/users/525a066628d44a0988cd2afa3c76420e/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.626043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ec40f81a0b422998f0364159352ac6, user_id=525a066628d44a0988cd2afa3c76420e, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.628617 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.642282 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1259/2559] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:01 2022] PUT /identity/v3/projects/56ec40f81a0b422998f0364159352ac6/users/525a066628d44a0988cd2afa3c76420e/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:01.646105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.655844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a512ade-4291-49e3-833c-f0c3e9015c74 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.722259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03190-1ccd-4169-af13-d4be8562ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.722929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03190-1ccd-4169-af13-d4be8562ab16 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.723317 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03190-1ccd-4169-af13-d4be8562ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.723476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03190-1ccd-4169-af13-d4be8562ab16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.724259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c03190-1ccd-4169-af13-d4be8562ab16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.726175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c03190-1ccd-4169-af13-d4be8562ab16 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.741466 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1301/2560] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:01.745468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.751147 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:01.757676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab824a6-f6df-4b7d-ba14-544a4952fa16 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.763349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.764071 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.764408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.764739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] PATH_INFO: `/v3/projects/56ec40f81a0b422998f0364159352ac6/users/525a066628d44a0988cd2afa3c76420e/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.766719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ec40f81a0b422998f0364159352ac6, user_id=525a066628d44a0988cd2afa3c76420e, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:01.769341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:01.780236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1260/2561] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:01 2022] PUT /identity/v3/projects/56ec40f81a0b422998f0364159352ac6/users/525a066628d44a0988cd2afa3c76420e/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:01.801630 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca17d-61c1-4a03-ab44-4b0affcd9d04 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.802514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca17d-61c1-4a03-ab44-4b0affcd9d04 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.803027 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cca17d-61c1-4a03-ab44-4b0affcd9d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:01.818538 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:01.840312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-49cca17d-61c1-4a03-ab44-4b0affcd9d04 None None] MFA Rules not processed for user `525a066628d44a0988cd2afa3c76420e`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:01.841647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-49cca17d-61c1-4a03-ab44-4b0affcd9d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:01.916193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1302/2562] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:01.923807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:01.925638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:01.986896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f544b5-557e-4913-88a9-97667454412c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:01.990596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1414f-bf63-40eb-b2fd-5389701be40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:01.991209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1414f-bf63-40eb-b2fd-5389701be40e service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:01.991472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1414f-bf63-40eb-b2fd-5389701be40e service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:01.991746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1414f-bf63-40eb-b2fd-5389701be40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:02.006714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1414f-bf63-40eb-b2fd-5389701be40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:02.009184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1414f-bf63-40eb-b2fd-5389701be40e service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:02.033960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1261/2563] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:02.122510 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca17d-61c1-4a03-ab44-4b0affcd9d04 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:02.133096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cca17d-61c1-4a03-ab44-4b0affcd9d04 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:02.137436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:02.138114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:02.138385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:02.138656 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:02.219064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:02.219064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:02.229807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1303/2564] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:04.248567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:04.249023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:04.249128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:04.268968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:04.270189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:04.326782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1262/2565] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:23:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:04.374462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:04.375918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:04.447973 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dd7fe-1f78-43de-b891-60800e55cae7 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:04.452968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:04.453605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:04.453890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:04.454167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:04.462996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:04.465061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:04.473319 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1304/2566] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:23:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:07.743670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:07.745700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:07.876274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589c290-3e3e-4c57-b743-71f211d39813 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:07.882473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cf71d-91c6-436d-971f-a7f3617f54c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:07.883106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cf71d-91c6-436d-971f-a7f3617f54c0 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:07.883368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cf71d-91c6-436d-971f-a7f3617f54c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:07.883637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cf71d-91c6-436d-971f-a7f3617f54c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:07.885967 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7f1cf71d-91c6-436d-971f-a7f3617f54c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:07.900850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cf71d-91c6-436d-971f-a7f3617f54c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:07.902980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cf71d-91c6-436d-971f-a7f3617f54c0 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:07.916892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1263/2567] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:09.792030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:09.818340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:09.871509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48323-9c81-4b94-bbc1-c2cbdb431cdd service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:09.876675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:09.877522 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:09.878005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:09.878402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] PATH_INFO: `/v3/users/86c1b2838c5c4e7b9e957a2372f16768` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:09.879675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c1b2838c5c4e7b9e957a2372f16768)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:09.881705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:09.944462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c1b2838c5c4e7b9e957a2372f16768'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:09.945182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c1b2838c5c4e7b9e957a2372f16768'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:09.964710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c1b2838c5c4e7b9e957a2372f16768'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:09.976100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c1b2838c5c4e7b9e957a2372f16768'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:09.976937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c1b2838c5c4e7b9e957a2372f16768'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:09.998514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1305/2568] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:09 2022] DELETE /identity/v3/users/86c1b2838c5c4e7b9e957a2372f16768 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:10.008781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:10.009365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:10.009365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:10.030802 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:10.032624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:10.052428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:10.111844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1264/2569] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:10.115033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:10.116530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:10.185992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6fd7e-2701-4446-b679-0743147359d2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:10.189860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:10.190501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:10.190777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:10.191054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:10.200465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:10.201980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:10.212852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1306/2570] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:10.614019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:10.615460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:10.631238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05a8f5-b062-46a4-81a3-ecfe554a87bf None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:10.637082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:10.638086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:10.638519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:10.638939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] PATH_INFO: `/v3/projects/450a61b86daa439da8778fff14278eea` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:10.640503 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=450a61b86daa439da8778fff14278eea)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:10.643630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:10.686714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:10.688479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:10.729532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b03bd-aebc-4dd2-984e-6137cddda382 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:10.736795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450a61b86daa439da8778fff14278eea', 'request_id': 'req-15336bf2-1cab-48bf-985a-3bb08a139aee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.750825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450a61b86daa439da8778fff14278eea', 'request_id': 'req-15336bf2-1cab-48bf-985a-3bb08a139aee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.758052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450a61b86daa439da8778fff14278eea', 'request_id': 'req-15336bf2-1cab-48bf-985a-3bb08a139aee'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.771066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] The token cache is being invalidate because project 450a61b86daa439da8778fff14278eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:10.771277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.771866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.773708 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1265/2571] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:10 2022] DELETE /identity/v3/projects/450a61b86daa439da8778fff14278eea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:10.777338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:10.778898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:10.786222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:10.808851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:10.809534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:10.809838 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:10.810055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] PATH_INFO: `/v3/users/eda53d190b77417ab88ccbcc670ed6c5` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:10.811748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda53d190b77417ab88ccbcc670ed6c5)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:10.813995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:10.870217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15336bf2-1cab-48bf-985a-3bb08a139aee admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:10.878433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:10.879475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:10.879746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda53d190b77417ab88ccbcc670ed6c5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.880154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:10.880484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda53d190b77417ab88ccbcc670ed6c5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.880817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] PATH_INFO: `/v3/users/525a066628d44a0988cd2afa3c76420e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:10.882600 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525a066628d44a0988cd2afa3c76420e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:10.885052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:10.895782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda53d190b77417ab88ccbcc670ed6c5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.904284 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda53d190b77417ab88ccbcc670ed6c5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.904890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-3f67e20c-e73d-4bed-b84d-fe2b54be72e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda53d190b77417ab88ccbcc670ed6c5'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.922470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1307/2572] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:10 2022] DELETE /identity/v3/users/eda53d190b77417ab88ccbcc670ed6c5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:10.927488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:10.927836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:10.928116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:10.953814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:10.957316 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:10.959424 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525a066628d44a0988cd2afa3c76420e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.960090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525a066628d44a0988cd2afa3c76420e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.961361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:10.969797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525a066628d44a0988cd2afa3c76420e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.982188 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525a066628d44a0988cd2afa3c76420e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:10.983393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525a066628d44a0988cd2afa3c76420e'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.007348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1266/2573] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:10 2022] DELETE /identity/v3/users/525a066628d44a0988cd2afa3c76420e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:11.046559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1308/2574] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:11.062825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.064476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.149330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7866c-32bc-4c54-a423-65ce7e0137c9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:11.154681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3aeaa-4092-401e-b551-6c05217a9dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:11.155464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3aeaa-4092-401e-b551-6c05217a9dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.155791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3aeaa-4092-401e-b551-6c05217a9dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.156063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3aeaa-4092-401e-b551-6c05217a9dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.262063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3aeaa-4092-401e-b551-6c05217a9dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:11.263677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3aeaa-4092-401e-b551-6c05217a9dd8 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:11.275645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1267/2575] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:11.324539 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.326376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.348404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4ce55-c0ab-4d7e-ad94-94f358eb4183 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:11.365154 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:11.365836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.366355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.366355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] PATH_INFO: `/v3/projects/56ec40f81a0b422998f0364159352ac6` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.374955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ec40f81a0b422998f0364159352ac6)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:11.377211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:11.464372 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ec40f81a0b422998f0364159352ac6', 'request_id': 'req-61aad8d4-5059-449a-89fb-c20cf6fa4903'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.470470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:11.472321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ec40f81a0b422998f0364159352ac6', 'request_id': 'req-61aad8d4-5059-449a-89fb-c20cf6fa4903'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.483925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ec40f81a0b422998f0364159352ac6', 'request_id': 'req-61aad8d4-5059-449a-89fb-c20cf6fa4903'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.501173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] The token cache is being invalidate because project 56ec40f81a0b422998f0364159352ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:11.501586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.502604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.509501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1309/2576] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:11 2022] DELETE /identity/v3/projects/56ec40f81a0b422998f0364159352ac6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:11.510533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ac32c-17e2-4894-83cf-36685ab4024e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.510677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ac32c-17e2-4894-83cf-36685ab4024e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.510941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ac32c-17e2-4894-83cf-36685ab4024e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.536977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e09ac32c-17e2-4894-83cf-36685ab4024e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:11.538819 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e09ac32c-17e2-4894-83cf-36685ab4024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.650595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.652960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.660199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1268/2577] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:11.674343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a555f-9b5c-4568-90c3-aa4b98deae14 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.674984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a555f-9b5c-4568-90c3-aa4b98deae14 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.675496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a555f-9b5c-4568-90c3-aa4b98deae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.690916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aad8d4-5059-449a-89fb-c20cf6fa4903 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:11.698443 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:11.699255 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.699551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.699829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] PATH_INFO: `/v3/projects/356a88f0fb564c6d926940e2fe47523b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.701012 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=356a88f0fb564c6d926940e2fe47523b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:11.704175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:11.713893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2a8a555f-9b5c-4568-90c3-aa4b98deae14 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:11.715831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2a8a555f-9b5c-4568-90c3-aa4b98deae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.724647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1269/2578] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:11.728468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a555f-9b5c-4568-90c3-aa4b98deae14 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.738718 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a555f-9b5c-4568-90c3-aa4b98deae14 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:11.746305 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:11.747093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.747542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.747905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.748737 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:11.749745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:11.751177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:11.755205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:11.775878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1270/2579] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:11.776965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.795222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356a88f0fb564c6d926940e2fe47523b', 'request_id': 'req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.797153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e573ac-1f9c-4381-b498-63c5aaeeb837 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:11.811566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356a88f0fb564c6d926940e2fe47523b', 'request_id': 'req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.828224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356a88f0fb564c6d926940e2fe47523b', 'request_id': 'req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.843744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] The token cache is being invalidate because project 356a88f0fb564c6d926940e2fe47523b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:11.844043 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.845139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:11.848343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1310/2580] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:11 2022] DELETE /identity/v3/projects/356a88f0fb564c6d926940e2fe47523b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:11.852989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.855671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.882683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:11.883302 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:11.883817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:11.884253 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:11.884897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:11.887073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:11.926685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1271/2581] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:11 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:11.930944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:11.935398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:11.953388 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1db5d7-0af1-41fb-bd89-73acbfb5d9ed admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.015783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698ac07-3cde-4f77-bd35-9810222d944d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.025524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.026713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.026991 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.027338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.027962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.030020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.039916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.040777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.040945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.041204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] PATH_INFO: `/v3/users/e4e73ce32e5d48b38e03184db83b1ce9` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.042652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e73ce32e5d48b38e03184db83b1ce9)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.045300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.061939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1272/2582] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:11 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:12.064665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:12.066653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.077648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59a0b1-5ff0-4407-bfc8-960fe2218d0a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.085579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.086294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.086679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.087136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.088167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.091093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.106496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1273/2583] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:12.110678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.117917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e73ce32e5d48b38e03184db83b1ce9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.119329 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e73ce32e5d48b38e03184db83b1ce9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.123040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b58e60-dc9d-4769-a07d-7228af319307 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.128232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.129043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.129393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.129759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.131406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.133012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.142545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e73ce32e5d48b38e03184db83b1ce9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.149948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1274/2584] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:12.154550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e73ce32e5d48b38e03184db83b1ce9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.155533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.156333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-23204a1a-b5a8-48f5-a55f-acd0d156fe00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e73ce32e5d48b38e03184db83b1ce9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.159979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:12.175764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025744f0-6e68-49f8-ae81-af5dfc370918 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.177477 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1311/2585] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:11 2022] DELETE /identity/v3/users/e4e73ce32e5d48b38e03184db83b1ce9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:12.246456 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:12.274910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.276990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.277364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.278995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] PATH_INFO: `/v3/projects/dad2ec776c414448971bfc2bfa0e5357/users/4506d0b172ac4e1ebb81429f9adfcf2e/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.302634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad2ec776c414448971bfc2bfa0e5357, user_id=4506d0b172ac4e1ebb81429f9adfcf2e, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.307711 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.328982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1275/2586] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:12 2022] PUT /identity/v3/projects/dad2ec776c414448971bfc2bfa0e5357/users/4506d0b172ac4e1ebb81429f9adfcf2e/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:12.341420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.341880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.342234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.404259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] MFA Rules not processed for user `4506d0b172ac4e1ebb81429f9adfcf2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:12.405671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:12.496798 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1312/2587] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:12.501258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.540017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.542103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:12.615808 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764df90-63bb-4d9f-899c-fb18e561cc82 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.622020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.622642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.622914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.623633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.623797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.630283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.646617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80531577-0184-4684-bfb8-9980c93d4c1d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.654711 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.655551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.655909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.656403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] PATH_INFO: `/v3/projects/c9eed868bba04308acd3ee7f94e7baf8` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.657533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9eed868bba04308acd3ee7f94e7baf8)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.659651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.673491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1276/2588] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:12 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:12.675187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.707021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:12.734071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9eed868bba04308acd3ee7f94e7baf8', 'request_id': 'req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.740415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9eed868bba04308acd3ee7f94e7baf8', 'request_id': 'req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.752287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9eed868bba04308acd3ee7f94e7baf8', 'request_id': 'req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.771988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1ff14-90eb-4142-9648-2cd2e3e5e2ba admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.772651 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] The token cache is being invalidate because project c9eed868bba04308acd3ee7f94e7baf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:12.772943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.773723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-feb5b27e-1c7d-47ce-80c0-8eaa42920dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:12.775248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1313/2589] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:12 2022] DELETE /identity/v3/projects/c9eed868bba04308acd3ee7f94e7baf8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:12.781176 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.781403 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.781704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.815121 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:12.816545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:12.846650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605b432-47ad-4e1a-9866-cc1120ce247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.847528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605b432-47ad-4e1a-9866-cc1120ce247d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.848070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605b432-47ad-4e1a-9866-cc1120ce247d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.848525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605b432-47ad-4e1a-9866-cc1120ce247d admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.849326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605b432-47ad-4e1a-9866-cc1120ce247d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.854320 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605b432-47ad-4e1a-9866-cc1120ce247d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.866827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:12.889491 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1314/2590] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:12.890137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1277/2591] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:12 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:12.890955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.892328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:12.897397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474fd5-ce60-47ce-967e-dc59b01fa0b0 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.897878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474fd5-ce60-47ce-967e-dc59b01fa0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.898299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474fd5-ce60-47ce-967e-dc59b01fa0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.909488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79c32-ad57-4cd5-bbb5-b64488068543 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.914801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.915398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.915679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.916046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.917951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.919207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.924645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ba474fd5-ce60-47ce-967e-dc59b01fa0b0 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:12.925987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ba474fd5-ce60-47ce-967e-dc59b01fa0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:12.933464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1315/2592] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:12.937198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.940336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1278/2593] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:12.944307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba474fd5-ce60-47ce-967e-dc59b01fa0b0 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:12.951740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ba2c3-32ec-448a-83a4-8c224dc9f664 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.954971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba474fd5-ce60-47ce-967e-dc59b01fa0b0 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:12.956604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.957254 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.957552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.957834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] PATH_INFO: `/v3/projects/e6c7883c08ad4f8d863eec511f706186/users/7c8db9065f78459fbc69011811b12284/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.960072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:12.960705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:12.961050 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:12.962240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:12.963882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:12.964254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.965950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.980451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c7883c08ad4f8d863eec511f706186, user_id=7c8db9065f78459fbc69011811b12284, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:12.983434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:12.988034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1279/2594] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:23:12.989210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.001715 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595997-b769-4293-864c-6d02906ad1d8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.017127 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1316/2595] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:12 2022] PUT /identity/v3/projects/e6c7883c08ad4f8d863eec511f706186/users/7c8db9065f78459fbc69011811b12284/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:13.018236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.075951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.076525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.077155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.077155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.077686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.079593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.120487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f269b-7ae3-47d2-b534-ff659fc7f6ea admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.120668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1280/2596] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:12 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:13.121691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.163381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:13.210436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c04b-5e4e-4b07-a153-9d8dda12602f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.219408 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.220026 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.221339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.221675 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.221962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.222566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.222849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.223126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.223274 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.223797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.225137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.225367 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.237715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1317/2597] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:13.242559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.249089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1281/2598] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:13 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:13.253087 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.254267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5de233-fec5-4694-827d-ac3779f0e249 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.259529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.261002 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.261282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.261598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] PATH_INFO: `/v3/projects/e6c7883c08ad4f8d863eec511f706186/users/7c8db9065f78459fbc69011811b12284/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.263615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c7883c08ad4f8d863eec511f706186, user_id=7c8db9065f78459fbc69011811b12284, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.264433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffd0f-4205-4d00-86bb-901116ca7bb9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.266274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.269383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4982c26-4a1e-4aa5-af80-358cc2c7970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.270024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982c26-4a1e-4aa5-af80-358cc2c7970b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.270280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982c26-4a1e-4aa5-af80-358cc2c7970b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.270556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982c26-4a1e-4aa5-af80-358cc2c7970b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.271203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4982c26-4a1e-4aa5-af80-358cc2c7970b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.272784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4982c26-4a1e-4aa5-af80-358cc2c7970b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.279486 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1318/2599] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:13 2022] PUT /identity/v3/projects/e6c7883c08ad4f8d863eec511f706186/users/7c8db9065f78459fbc69011811b12284/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:13.285550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1282/2600] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:13.288785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.289781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.290238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.290660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.320258 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] MFA Rules not processed for user `7c8db9065f78459fbc69011811b12284`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:13.321839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:13.353937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:13.381288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767f59e-9dd7-4394-9404-b986067acd07 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.387675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.388571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.389087 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.389591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.391225 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.393034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.409686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1319/2601] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:13.411115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.419596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1283/2602] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:13.423847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a696b-1f99-46a6-8491-6a3aa9d4c845 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.426518 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.428155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:13.428996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd333-dfb4-4c03-9730-307296cc14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.431756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd333-dfb4-4c03-9730-307296cc14c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.431756 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd333-dfb4-4c03-9730-307296cc14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.432481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd333-dfb4-4c03-9730-307296cc14c0 admin admin] PATH_INFO: `/v3/projects/b467d6c0767942768d28dea204c68a22/users/9c9b49f8211e41d081408d9fd9ee413d/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.449211 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd333-dfb4-4c03-9730-307296cc14c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b467d6c0767942768d28dea204c68a22, user_id=9c9b49f8211e41d081408d9fd9ee413d, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.452250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd333-dfb4-4c03-9730-307296cc14c0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.472605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1320/2603] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:13 2022] PUT /identity/v3/projects/b467d6c0767942768d28dea204c68a22/users/9c9b49f8211e41d081408d9fd9ee413d/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:13.483340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602a4ce-82ae-46e8-be61-aeb6626d22fe None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.483861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602a4ce-82ae-46e8-be61-aeb6626d22fe None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.484112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602a4ce-82ae-46e8-be61-aeb6626d22fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.496869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b85c43-d8c8-48fc-82c6-fe2c09a62c54 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.516145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f602a4ce-82ae-46e8-be61-aeb6626d22fe None None] MFA Rules not processed for user `9c9b49f8211e41d081408d9fd9ee413d`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:13.517616 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f602a4ce-82ae-46e8-be61-aeb6626d22fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:13.568733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.569746 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.570210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.570880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.597688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1321/2604] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:13.602437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602a4ce-82ae-46e8-be61-aeb6626d22fe None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.617980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:13.667615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.669288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.680597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1284/2605] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:13.695936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602a4ce-82ae-46e8-be61-aeb6626d22fe None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.702306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.703032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.703228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.703493 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.704298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.706250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.749393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1322/2606] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:13 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:13.760556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.781252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70bf0-a481-4c40-af9d-704173a28038 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.810593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:13.871542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.872075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.872354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.872621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.873926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.876084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.907867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1285/2607] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:13 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:13.911796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.928281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723dba-5074-41f3-9e8b-85d7bf052612 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.936275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.937017 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.937352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.937707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:13.938393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:13.940279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:13.952248 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1323/2608] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:13.957404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:13.972383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3bd9-23b6-41e7-8b95-edebaa8c0b72 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:13.983863 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:13.984630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:13.984910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:13.985202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] PATH_INFO: `/v3/projects/38bb4851e8424843b0e11b2527c874bd/users/820f6c8745c04eedb118116944f97645/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.006037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bb4851e8424843b0e11b2527c874bd, user_id=820f6c8745c04eedb118116944f97645, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.009820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.025060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1286/2609] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:13 2022] PUT /identity/v3/projects/38bb4851e8424843b0e11b2527c874bd/users/820f6c8745c04eedb118116944f97645/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:14.029742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.041014 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76799db1-22b7-4084-8cc8-02b736929140 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.115243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.115862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.116313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.116590 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.117299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.119081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.133313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1324/2610] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:14.134641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.160225 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83f12-6b4a-4a47-9e2f-1a506d5894d7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.166030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acd770-0fcb-4663-bcd2-872128ed6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.167537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd770-0fcb-4663-bcd2-872128ed6564 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.167890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd770-0fcb-4663-bcd2-872128ed6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.168168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acd770-0fcb-4663-bcd2-872128ed6564 admin admin] PATH_INFO: `/v3/projects/38bb4851e8424843b0e11b2527c874bd/users/820f6c8745c04eedb118116944f97645/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.170196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acd770-0fcb-4663-bcd2-872128ed6564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bb4851e8424843b0e11b2527c874bd, user_id=820f6c8745c04eedb118116944f97645, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.172956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acd770-0fcb-4663-bcd2-872128ed6564 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.188623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.190032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1287/2611] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:14 2022] PUT /identity/v3/projects/38bb4851e8424843b0e11b2527c874bd/users/820f6c8745c04eedb118116944f97645/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:14.206637 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.207372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.207965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.250515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] MFA Rules not processed for user `820f6c8745c04eedb118116944f97645`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:14.252507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:14.310399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aaca7-2a2d-45a2-9e2b-813ddd799eb6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.347432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1288/2612] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:14.355936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:14.360231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.362378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:14.408266 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c8db9065f78459fbc69011811b12284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6c7883c08ad4f8d863eec511f706186', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.409930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.410516 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.411019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.412376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:14.413074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.415408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.430093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf818cd-b6f9-48eb-97b9-f6d35811e43e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.434437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.435153 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.435436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.435710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.437720 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1325/2613] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:14.446464 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.447945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.455181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.467744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169618e6-4304-458a-92ef-16136d23c74a tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.468254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1289/2614] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:14.473324 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c8db9065f78459fbc69011811b12284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6c7883c08ad4f8d863eec511f706186', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.474527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.482505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.482505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.482505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.490471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.529068 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1326/2615] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:14 2022] POST /identity/v3/projects => generated 354 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:14.534597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.547024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4ece-c425-443f-bdbc-568bcbd6b79f service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.560299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:14.564753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.632747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c8db9065f78459fbc69011811b12284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6c7883c08ad4f8d863eec511f706186', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.633370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.633687 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.634422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.635762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:14.636048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.638077 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.651875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1290/2616] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:14.652535 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596e9b-d118-4841-abf5-54caedfa7285 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.656826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.657834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.658177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.658568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.692435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:14.705898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47409-54e2-4539-b1e3-725aa6071f68 tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:14.710978 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c8db9065f78459fbc69011811b12284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6c7883c08ad4f8d863eec511f706186', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:14.712137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:14.712407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:14.712930 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] PATH_INFO: `/v3/projects/de99962ceb8e478bb8949e618177680a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:14.714842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de99962ceb8e478bb8949e618177680a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.716933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.722455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:14.723823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:14.733322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1327/2617] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:14.769709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de99962ceb8e478bb8949e618177680a', 'request_id': 'req-c12081e5-32fc-423f-9313-ae7f6b7700bf'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:14.779550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de99962ceb8e478bb8949e618177680a', 'request_id': 'req-c12081e5-32fc-423f-9313-ae7f6b7700bf'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:14.786128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de99962ceb8e478bb8949e618177680a', 'request_id': 'req-c12081e5-32fc-423f-9313-ae7f6b7700bf'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:14.797800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] The token cache is being invalidate because project de99962ceb8e478bb8949e618177680a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:14.798075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:14.798721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c12081e5-32fc-423f-9313-ae7f6b7700bf tempest-VolumeQuotaClassesTest-1206575798 tempest-VolumeQuotaClassesTest-1206575798-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:14.800213 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1291/2618] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:14 2022] DELETE /identity/v3/projects/de99962ceb8e478bb8949e618177680a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:15.008827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:15.077792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:15.084475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc6a54-4dbd-448e-a1c5-dcf9d5f93dd5 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:15.141374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:15.142025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:15.142305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:15.142575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] PATH_INFO: `/v3/users/4506d0b172ac4e1ebb81429f9adfcf2e` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:15.143719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4506d0b172ac4e1ebb81429f9adfcf2e)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:15.145648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:15.192337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4506d0b172ac4e1ebb81429f9adfcf2e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.192909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4506d0b172ac4e1ebb81429f9adfcf2e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.205435 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4506d0b172ac4e1ebb81429f9adfcf2e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.212908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4506d0b172ac4e1ebb81429f9adfcf2e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.213660 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4506d0b172ac4e1ebb81429f9adfcf2e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.227306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1328/2619] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:15 2022] DELETE /identity/v3/users/4506d0b172ac4e1ebb81429f9adfcf2e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:15.232589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:15.233109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:15.233212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:15.253942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:15.255164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:15.312583 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1292/2620] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:15.323520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:15.325164 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:15.382755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b845-da5b-460e-aa77-4f4d117f32f9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:15.386994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:15.387593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:15.387893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:15.388163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:15.397376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:15.398861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:15.409413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1329/2621] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:15.719183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:15.720682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:15.733012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db6dbb-ca3e-4106-9db2-038669a8bc59 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:15.739846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:15.740616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:15.740993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:15.741364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] PATH_INFO: `/v3/projects/dad2ec776c414448971bfc2bfa0e5357` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:15.743045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad2ec776c414448971bfc2bfa0e5357)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:15.745384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:15.770800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:15.796669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad2ec776c414448971bfc2bfa0e5357', 'request_id': 'req-daccdead-6ecc-4bb1-88db-0d54add516a4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.804270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad2ec776c414448971bfc2bfa0e5357', 'request_id': 'req-daccdead-6ecc-4bb1-88db-0d54add516a4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.810702 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad2ec776c414448971bfc2bfa0e5357', 'request_id': 'req-daccdead-6ecc-4bb1-88db-0d54add516a4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.822612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] The token cache is being invalidate because project dad2ec776c414448971bfc2bfa0e5357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:15.823515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.824185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:15.825788 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1293/2622] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:15 2022] DELETE /identity/v3/projects/dad2ec776c414448971bfc2bfa0e5357 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:15.829866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:15.840066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2015d-1e59-494c-b8c0-daee91c98873 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:15.859902 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:16.022962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.023648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.023847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.024114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] PATH_INFO: `/v3/users/7c8db9065f78459fbc69011811b12284` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.025251 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8db9065f78459fbc69011811b12284)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.027208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:16.074795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8db9065f78459fbc69011811b12284'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.075502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8db9065f78459fbc69011811b12284'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.089313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8db9065f78459fbc69011811b12284'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.097721 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8db9065f78459fbc69011811b12284'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.098428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-b0b83193-b2e0-48d6-b73d-79ee74bdecbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8db9065f78459fbc69011811b12284'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.112188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1330/2623] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:15 2022] DELETE /identity/v3/users/7c8db9065f78459fbc69011811b12284 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:16.404054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:16.405621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:16.430086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccdead-6ecc-4bb1-88db-0d54add516a4 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:16.489894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.490519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.490793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.491073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] PATH_INFO: `/v3/projects/e6c7883c08ad4f8d863eec511f706186` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.492156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c7883c08ad4f8d863eec511f706186)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.494057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:16.540086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c7883c08ad4f8d863eec511f706186', 'request_id': 'req-63e8d817-d18f-42b0-9c59-5902bb017aae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.548764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c7883c08ad4f8d863eec511f706186', 'request_id': 'req-63e8d817-d18f-42b0-9c59-5902bb017aae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.554804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c7883c08ad4f8d863eec511f706186', 'request_id': 'req-63e8d817-d18f-42b0-9c59-5902bb017aae'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.566766 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] The token cache is being invalidate because project e6c7883c08ad4f8d863eec511f706186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:16.567049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.567673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-63e8d817-d18f-42b0-9c59-5902bb017aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:16.569240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1294/2624] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:16 2022] DELETE /identity/v3/projects/e6c7883c08ad4f8d863eec511f706186 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:16.574242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110ad0-4231-44a7-ac59-18fb55b3f312 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.574530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110ad0-4231-44a7-ac59-18fb55b3f312 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.574829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110ad0-4231-44a7-ac59-18fb55b3f312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.594963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0f110ad0-4231-44a7-ac59-18fb55b3f312 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:16.596163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0f110ad0-4231-44a7-ac59-18fb55b3f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:16.653880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1331/2625] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:16.661492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94510798-d355-4596-806e-bc4eeb44ca3c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.661870 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94510798-d355-4596-806e-bc4eeb44ca3c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.662146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94510798-d355-4596-806e-bc4eeb44ca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.682220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-94510798-d355-4596-806e-bc4eeb44ca3c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:16.683416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-94510798-d355-4596-806e-bc4eeb44ca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:16.691570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1295/2626] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:16.697485 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f110ad0-4231-44a7-ac59-18fb55b3f312 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:16.707085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f110ad0-4231-44a7-ac59-18fb55b3f312 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:16.711705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.712291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.712565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.713086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.714261 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:16.714557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.716116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:16.727506 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1332/2627] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:23:16.732196 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94510798-d355-4596-806e-bc4eeb44ca3c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:16.741716 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94510798-d355-4596-806e-bc4eeb44ca3c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:16.746400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.747645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.747926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.748193 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.748814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.750712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:16.781540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1296/2628] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:16 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:16.782948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:16.792944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b890d-9efb-4d09-b598-bb1eba38c0e4 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:16.821799 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:16.855112 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.855733 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.856005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.856268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.856897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.858823 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:16.880530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1333/2629] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:16 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:16.884552 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:16.895407 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda96dc-d776-4797-8128-d82397a1d241 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:16.900093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.900690 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.901027 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.901299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.901968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.903528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:16.908740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:16.914811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1297/2630] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:16.920146 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:16.930007 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77148137-b486-4818-9f23-5e21f1ee6e23 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:16.935370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c498e3-b813-4437-b28b-53c5ac073955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.935963 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498e3-b813-4437-b28b-53c5ac073955 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.936231 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498e3-b813-4437-b28b-53c5ac073955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.936500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498e3-b813-4437-b28b-53c5ac073955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.937215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c498e3-b813-4437-b28b-53c5ac073955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.938807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c498e3-b813-4437-b28b-53c5ac073955 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:16.948729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1334/2631] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:16.952813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:16.963058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991c7e4-b156-41bf-81f2-0124bd74bae9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:16.967682 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:16.968319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:16.968599 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:16.968882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] PATH_INFO: `/v3/projects/69b59427f787416eb7e22966f6ec74bc/users/11ef14ec9d0c4637ad3f5e3ccfddfb08/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:16.986307 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b59427f787416eb7e22966f6ec74bc, user_id=11ef14ec9d0c4637ad3f5e3ccfddfb08, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:16.988941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.003224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1298/2632] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:16 2022] PUT /identity/v3/projects/69b59427f787416eb7e22966f6ec74bc/users/11ef14ec9d0c4637ad3f5e3ccfddfb08/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:17.014426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae7f4-4b12-4726-ae75-c308d32a338a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.014710 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae7f4-4b12-4726-ae75-c308d32a338a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.014978 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae7f4-4b12-4726-ae75-c308d32a338a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.042637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c82ae7f4-4b12-4726-ae75-c308d32a338a None None] MFA Rules not processed for user `11ef14ec9d0c4637ad3f5e3ccfddfb08`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:17.043897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c82ae7f4-4b12-4726-ae75-c308d32a338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:17.106752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1335/2633] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:17.111222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.172824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654b2aa-35f2-4abe-8865-421fa68c0a4f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.177460 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.178086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.178362 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.178631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.179261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.181134 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.206784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1299/2634] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:17 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:17.210949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ae7f4-4b12-4726-ae75-c308d32a338a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.222544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ae7f4-4b12-4726-ae75-c308d32a338a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.277550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.278151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.278430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.278701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.279328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.281210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.302467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1336/2635] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:17 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:17.306443 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.316623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adec002-f28f-4c8a-ae0b-73a86caacd41 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.321684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.322331 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.322615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.322882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.323554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.325283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.337428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1300/2636] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:17.342499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.354718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d016d74-a925-44d2-8cce-30ce94b9f326 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.359410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.360000 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.360273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.360537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.361204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.363482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.370120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.371854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:17.377818 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1337/2637] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:17.378736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.384457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd5d0-7876-41d7-b6d6-04e096b9c5d9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.388787 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadb020-16e5-4238-9022-cb9312322bf0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.389169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.389829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.390144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.390374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] PATH_INFO: `/v3/users/9c9b49f8211e41d081408d9fd9ee413d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.391493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9b49f8211e41d081408d9fd9ee413d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.393262 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb494-814c-43e5-b0cd-db9568abf923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.393398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.393927 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb494-814c-43e5-b0cd-db9568abf923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.394210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb494-814c-43e5-b0cd-db9568abf923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.394474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb494-814c-43e5-b0cd-db9568abf923 admin admin] PATH_INFO: `/v3/projects/8ee0d26f4b6c4022a03c002da2777e75/users/7fa9279910264af8b881e7e548cdd25a/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.409381 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb494-814c-43e5-b0cd-db9568abf923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee0d26f4b6c4022a03c002da2777e75, user_id=7fa9279910264af8b881e7e548cdd25a, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.411998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb494-814c-43e5-b0cd-db9568abf923 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.414290 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:17.428760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1338/2638] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:17 2022] PUT /identity/v3/projects/8ee0d26f4b6c4022a03c002da2777e75/users/7fa9279910264af8b881e7e548cdd25a/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:17.439558 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.439826 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.440292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.444846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9b49f8211e41d081408d9fd9ee413d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:17.445550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9b49f8211e41d081408d9fd9ee413d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:17.452784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9b49f8211e41d081408d9fd9ee413d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:17.460767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9b49f8211e41d081408d9fd9ee413d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:17.461620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-47b334a7-53a9-4352-a6b6-c3a50cc2d3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9b49f8211e41d081408d9fd9ee413d'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:17.471037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] MFA Rules not processed for user `7fa9279910264af8b881e7e548cdd25a`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:17.472253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:17.481360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1301/2639] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:17 2022] DELETE /identity/v3/users/9c9b49f8211e41d081408d9fd9ee413d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:17.485676 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.485968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.486241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.504910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:17.506138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:17.522818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:17.537458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1339/2640] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:17.542006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.543306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:17.568498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1302/2641] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:17.579412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.580255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:17.616822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95ba8f-8570-47e9-8d20-ca2d4c7b83e8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.622570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.623106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.623432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.623796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.624439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.626494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.642945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ca225-a04b-4924-ab8c-817b6f05161d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.647465 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.648457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.648457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.648650 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.660512 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.661938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.663086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1340/2642] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:17 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:17.667108 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.673916 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1303/2643] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:17.740220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118281d-db01-4a17-8132-47666f1f0833 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.745938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.746763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.747042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.747369 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.748120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.750236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.767322 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:17.780605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1341/2644] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:17 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:17.784481 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.795229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0798f8-d6eb-475e-bad4-997e65ce0723 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.799902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.800498 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.800774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.801201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.801731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.803288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.813685 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1304/2645] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:17.817802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.828865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fff66-1b1d-40cf-91f3-539e0f39b5e5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.834375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.835541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.835541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.835541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] PATH_INFO: `/v3/projects/cb53d5df449e44ea94be92d52dcd45a2/users/011020b4d79d4f4b8080fc4b6bf1b34a/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.851619 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb53d5df449e44ea94be92d52dcd45a2, user_id=011020b4d79d4f4b8080fc4b6bf1b34a, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.854314 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.867581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1342/2646] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:17 2022] PUT /identity/v3/projects/cb53d5df449e44ea94be92d52dcd45a2/users/011020b4d79d4f4b8080fc4b6bf1b34a/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:17.871957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.882368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6f8a-9601-407b-91c5-045b2352fbb7 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.957871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.958966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.959351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.959620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:17.960230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:17.961977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:17.967193 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.971739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:17.973448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1305/2647] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:17.982435 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:17.989350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc20a19-ef50-4b1c-9d03-f71bd44ba723 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:17.998243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:17.998243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:17.998243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:17.998939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] PATH_INFO: `/v3/projects/b467d6c0767942768d28dea204c68a22` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.000025 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b467d6c0767942768d28dea204c68a22)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:18.001949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:18.003514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770e57-943f-4c45-bcdd-10be4ee4a4b6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:18.021453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0303b-cb2e-458f-8058-87bf94be46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:18.022322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0303b-cb2e-458f-8058-87bf94be46ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.022565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0303b-cb2e-458f-8058-87bf94be46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.022827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0303b-cb2e-458f-8058-87bf94be46ac admin admin] PATH_INFO: `/v3/projects/cb53d5df449e44ea94be92d52dcd45a2/users/011020b4d79d4f4b8080fc4b6bf1b34a/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.025090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0303b-cb2e-458f-8058-87bf94be46ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb53d5df449e44ea94be92d52dcd45a2, user_id=011020b4d79d4f4b8080fc4b6bf1b34a, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:18.027897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0303b-cb2e-458f-8058-87bf94be46ac admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:18.040306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1306/2648] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:17 2022] PUT /identity/v3/projects/cb53d5df449e44ea94be92d52dcd45a2/users/011020b4d79d4f4b8080fc4b6bf1b34a/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:18.051596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.051889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.052160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.073898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b467d6c0767942768d28dea204c68a22', 'request_id': 'req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.086358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b467d6c0767942768d28dea204c68a22', 'request_id': 'req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.097286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] MFA Rules not processed for user `011020b4d79d4f4b8080fc4b6bf1b34a`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:18.098057 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.101086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b467d6c0767942768d28dea204c68a22', 'request_id': 'req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.113272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] The token cache is being invalidate because project b467d6c0767942768d28dea204c68a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:18.113593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.114346 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.115813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1343/2649] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:17 2022] DELETE /identity/v3/projects/b467d6c0767942768d28dea204c68a22 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:18.120951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:18.122545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.157056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:18.201326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfe4b5-7df1-4b03-9585-3f8ea5baf6df admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:18.207313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:18.208175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.208706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.209050 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] PATH_INFO: `/v3/users/820f6c8745c04eedb118116944f97645` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.210227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820f6c8745c04eedb118116944f97645)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:18.212205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:18.214829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1307/2650] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:18.226313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:18.228628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.270077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820f6c8745c04eedb118116944f97645'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.270880 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820f6c8745c04eedb118116944f97645'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.280299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:18.286438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820f6c8745c04eedb118116944f97645'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.295357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820f6c8745c04eedb118116944f97645'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.296455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820f6c8745c04eedb118116944f97645'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.297200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c19134-092e-445c-9fae-abb2fbec991b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:18.301957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:18.302625 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.302903 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.303374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.305261 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.310741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1344/2651] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:18 2022] DELETE /identity/v3/users/820f6c8745c04eedb118116944f97645 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:18.319608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:18.321703 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:18.332707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1308/2652] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:18.636934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:18.638411 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.714204 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:18.715762 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.720822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59871a7a-e0b2-429c-aa60-abcc566fcbd6 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:18.726349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:18.727036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.727313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.727582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] PATH_INFO: `/v3/projects/38bb4851e8424843b0e11b2527c874bd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.729030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38bb4851e8424843b0e11b2527c874bd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:18.730979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:18.779405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677e6e-f137-41df-a212-f13c36b6ef95 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:18.784988 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38bb4851e8424843b0e11b2527c874bd', 'request_id': 'req-83fb0639-62f4-4021-9bb1-821969943509'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.791268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38bb4851e8424843b0e11b2527c874bd', 'request_id': 'req-83fb0639-62f4-4021-9bb1-821969943509'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.801952 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38bb4851e8424843b0e11b2527c874bd', 'request_id': 'req-83fb0639-62f4-4021-9bb1-821969943509'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.815713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] The token cache is being invalidate because project 38bb4851e8424843b0e11b2527c874bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:18.815995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.816652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-83fb0639-62f4-4021-9bb1-821969943509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:18.818422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1345/2653] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:18 2022] DELETE /identity/v3/projects/38bb4851e8424843b0e11b2527c874bd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:18.823740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67bdea-5950-4152-8752-2ae4e120b721 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.824023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67bdea-5950-4152-8752-2ae4e120b721 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.824293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67bdea-5950-4152-8752-2ae4e120b721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.836517 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47042973-cfbe-4836-8c4d-22be38672a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:18.837173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042973-cfbe-4836-8c4d-22be38672a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.837475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042973-cfbe-4836-8c4d-22be38672a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.838184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47042973-cfbe-4836-8c4d-22be38672a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.840461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-47042973-cfbe-4836-8c4d-22be38672a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.845565 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7b67bdea-5950-4152-8752-2ae4e120b721 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:18.846745 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7b67bdea-5950-4152-8752-2ae4e120b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.852411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042973-cfbe-4836-8c4d-22be38672a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:18.854129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47042973-cfbe-4836-8c4d-22be38672a65 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:18.866958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1309/2654] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:18.927376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1346/2655] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:18.936290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:18.936478 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:18.936959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:18.967636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:18.968954 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:18.988559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67bdea-5950-4152-8752-2ae4e120b721 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:18.997668 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1310/2656] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:19.002291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67bdea-5950-4152-8752-2ae4e120b721 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.012311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271be264-4656-45ea-b133-789aa89ebd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.012311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be264-4656-45ea-b133-789aa89ebd14 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.012311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be264-4656-45ea-b133-789aa89ebd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.012311 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be264-4656-45ea-b133-789aa89ebd14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.012692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271be264-4656-45ea-b133-789aa89ebd14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:19.012692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271be264-4656-45ea-b133-789aa89ebd14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.012692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271be264-4656-45ea-b133-789aa89ebd14 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.013643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:19.023893 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.026042 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.030514 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1347/2657] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:19.034897 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a549a-2d84-4b51-ba7e-cc6e022fdfef None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.035159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a549a-2d84-4b51-ba7e-cc6e022fdfef None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.035432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a549a-2d84-4b51-ba7e-cc6e022fdfef None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.036673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1348/2658] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:19.037337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a549a-2d84-4b51-ba7e-cc6e022fdfef None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.051042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a549a-2d84-4b51-ba7e-cc6e022fdfef None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.055632 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede24a-bb24-458f-8cd3-32c28eca9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.056223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede24a-bb24-458f-8cd3-32c28eca9801 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.056498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede24a-bb24-458f-8cd3-32c28eca9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.056767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede24a-bb24-458f-8cd3-32c28eca9801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.058023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede24a-bb24-458f-8cd3-32c28eca9801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.060243 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede24a-bb24-458f-8cd3-32c28eca9801 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.060395 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:19.090903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1349/2659] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:19 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:19.092105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e938-7477-4e5b-aa2e-aab12c0e9d17 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.092386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e938-7477-4e5b-aa2e-aab12c0e9d17 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.092657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e938-7477-4e5b-aa2e-aab12c0e9d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.104619 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5e1d0-0894-4063-860a-86e54054d9eb None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.114384 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0b97e938-7477-4e5b-aa2e-aab12c0e9d17 None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:19.115577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0b97e938-7477-4e5b-aa2e-aab12c0e9d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.172122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.172831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.173010 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.173268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.175060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.194613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1350/2660] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:19.195447 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e938-7477-4e5b-aa2e-aab12c0e9d17 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.238647 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.240118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.249645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1311/2661] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:19.250450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.251742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.261268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e938-7477-4e5b-aa2e-aab12c0e9d17 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.270742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.271363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.271626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.271898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.272526 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.274467 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.308463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1351/2662] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:19 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:19.312829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.320953 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0581-8692-4b5f-8e5b-4023b2987257 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.325071 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4fa31-a14a-400e-899e-66e7e4ee81d3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.325473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa77ec9b56cd4027b22fbe0d7ff3ee1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.326113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.326392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.326742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.330323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.330917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.331253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.331654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.332625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.336153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.337700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.340285 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.351957 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1312/2663] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:19.356073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1352/2664] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:19.359267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.371663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcdbf9-5a03-40c0-8ffb-aabf20605bc2 service glance] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.378337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891561e-aef4-46d0-a6ea-056d97d2566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.378879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891561e-aef4-46d0-a6ea-056d97d2566a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.379238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891561e-aef4-46d0-a6ea-056d97d2566a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.379446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891561e-aef4-46d0-a6ea-056d97d2566a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.380199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891561e-aef4-46d0-a6ea-056d97d2566a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.382185 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891561e-aef4-46d0-a6ea-056d97d2566a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.398874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.399769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1313/2665] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:19.411699 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8f98-2bad-4ec0-9d7f-c6549465c3ef admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.417890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060660f-cc78-40e7-a3fc-ebe9f5b01b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.419177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060660f-cc78-40e7-a3fc-ebe9f5b01b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.419177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060660f-cc78-40e7-a3fc-ebe9f5b01b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.419371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060660f-cc78-40e7-a3fc-ebe9f5b01b11 admin admin] PATH_INFO: `/v3/projects/73486f2e799e4be8b513c34382020f97/users/25062b26257b440f83e845140afae8a7/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.427908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c591-b0c1-4293-9727-015ab93c85e6 None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.428271 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c591-b0c1-4293-9727-015ab93c85e6 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.428541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c591-b0c1-4293-9727-015ab93c85e6 None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.430412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1314/2666] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:19.436306 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.436591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.436864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.437864 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060660f-cc78-40e7-a3fc-ebe9f5b01b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73486f2e799e4be8b513c34382020f97, user_id=25062b26257b440f83e845140afae8a7, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.440456 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060660f-cc78-40e7-a3fc-ebe9f5b01b11 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.453921 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1353/2667] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:19 2022] PUT /identity/v3/projects/73486f2e799e4be8b513c34382020f97/users/25062b26257b440f83e845140afae8a7/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:19.465474 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] MFA Rules not processed for user `f520107f73aa48f791461922a3d6ec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:19.465990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099beb5-083b-44d4-be72-2c4e7f8ff625 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.466273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099beb5-083b-44d4-be72-2c4e7f8ff625 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.466541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099beb5-083b-44d4-be72-2c4e7f8ff625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.467259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.486911 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:19.497170 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6099beb5-083b-44d4-be72-2c4e7f8ff625 None None] MFA Rules not processed for user `25062b26257b440f83e845140afae8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:19.498474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6099beb5-083b-44d4-be72-2c4e7f8ff625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.506896 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:19.545663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1315/2668] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:19.554563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.556375 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.569176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1728bc-6a0f-4257-bb9b-d2bcbed0d37c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.573313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2cace-0af2-4821-a947-bab20e918738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.574372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2cace-0af2-4821-a947-bab20e918738 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.574670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2cace-0af2-4821-a947-bab20e918738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.574951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2cace-0af2-4821-a947-bab20e918738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.589880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2cace-0af2-4821-a947-bab20e918738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.593266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2cace-0af2-4821-a947-bab20e918738 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.595541 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1354/2669] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:19.602989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1316/2670] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:19.608361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099beb5-083b-44d4-be72-2c4e7f8ff625 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.678586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099beb5-083b-44d4-be72-2c4e7f8ff625 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.682308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.683079 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.683352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.683754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.694232 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.695730 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.699907 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a611-89b5-4eb1-b94e-474b9c3d84eb None None] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.700315 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a611-89b5-4eb1-b94e-474b9c3d84eb None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.700666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502a611-89b5-4eb1-b94e-474b9c3d84eb None None] PATH_INFO: `/` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.702418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1317/2671] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:19.706785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1355/2672] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:19.710100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975afe-cefe-4191-84ff-83205beced5f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.710505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975afe-cefe-4191-84ff-83205beced5f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.710843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975afe-cefe-4191-84ff-83205beced5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.730684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.737334 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5f975afe-cefe-4191-84ff-83205beced5f None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:19.738888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5f975afe-cefe-4191-84ff-83205beced5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:19.804715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee04c-19f8-4575-b54e-416c1b02d21e service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.809795 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.810591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.810972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.811375 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] PATH_INFO: `/v3/users/25062b26257b440f83e845140afae8a7` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.812547 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25062b26257b440f83e845140afae8a7)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.814895 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.824438 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1318/2673] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:19.837067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975afe-cefe-4191-84ff-83205beced5f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:19.848000 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975afe-cefe-4191-84ff-83205beced5f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:19.852012 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00478f9-f188-4d32-a7d7-d2e2704b0038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:19.852609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00478f9-f188-4d32-a7d7-d2e2704b0038 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.852914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00478f9-f188-4d32-a7d7-d2e2704b0038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.853397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00478f9-f188-4d32-a7d7-d2e2704b0038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.864660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00478f9-f188-4d32-a7d7-d2e2704b0038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:19.866207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00478f9-f188-4d32-a7d7-d2e2704b0038 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:19.869911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25062b26257b440f83e845140afae8a7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:19.870608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25062b26257b440f83e845140afae8a7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:19.875891 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:19.877074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1319/2674] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:19.884876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25062b26257b440f83e845140afae8a7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:19.892604 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25062b26257b440f83e845140afae8a7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:19.893797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25062b26257b440f83e845140afae8a7'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:19.907264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1356/2675] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:19 2022] DELETE /identity/v3/users/25062b26257b440f83e845140afae8a7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:19.911616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:19.911905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:19.912224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:19.939914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:19.941128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:20.003740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1320/2676] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:20.019530 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.020937 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:20.080195 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc33d8-9e00-4ceb-a395-3d7b13844bc2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.083883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4737-803d-4b1f-8203-d344c4cd2368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.084479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4737-803d-4b1f-8203-d344c4cd2368 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.084754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4737-803d-4b1f-8203-d344c4cd2368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.085033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4737-803d-4b1f-8203-d344c4cd2368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.095637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4737-803d-4b1f-8203-d344c4cd2368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.097281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4737-803d-4b1f-8203-d344c4cd2368 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:20.108948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1357/2677] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:20.411544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.413586 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:20.428400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52dc97-b433-4008-bcdb-1519fd5ee00e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.438783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.439436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.439747 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.439982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] PATH_INFO: `/v3/projects/73486f2e799e4be8b513c34382020f97` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.442360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73486f2e799e4be8b513c34382020f97)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.444431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:20.479657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:20.496974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73486f2e799e4be8b513c34382020f97', 'request_id': 'req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:20.506397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73486f2e799e4be8b513c34382020f97', 'request_id': 'req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:20.512072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73486f2e799e4be8b513c34382020f97', 'request_id': 'req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:20.524608 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] The token cache is being invalidate because project 73486f2e799e4be8b513c34382020f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:20.524871 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:20.525525 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cab9a5c9-7557-4dff-8c0b-c5b6b92be325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:20.527059 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1321/2678] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:20 2022] DELETE /identity/v3/projects/73486f2e799e4be8b513c34382020f97 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:20.532094 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250de62-bb27-47db-b56a-ab5929f69826 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.532383 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250de62-bb27-47db-b56a-ab5929f69826 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.532686 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250de62-bb27-47db-b56a-ab5929f69826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.552487 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-c250de62-bb27-47db-b56a-ab5929f69826 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:20.553753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c250de62-bb27-47db-b56a-ab5929f69826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:20.620355 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1358/2679] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:20.628418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0a28f-6b9f-4c4f-ae6a-3ef30d4d296d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.628605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0a28f-6b9f-4c4f-ae6a-3ef30d4d296d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.628892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0a28f-6b9f-4c4f-ae6a-3ef30d4d296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.650605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-72b0a28f-6b9f-4c4f-ae6a-3ef30d4d296d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:20.651707 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-72b0a28f-6b9f-4c4f-ae6a-3ef30d4d296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:20.663851 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1322/2680] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:20.668649 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250de62-bb27-47db-b56a-ab5929f69826 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.679719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250de62-bb27-47db-b56a-ab5929f69826 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.687526 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.688099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.688376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.688907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.689583 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:20.690370 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.691986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:20.704425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1359/2681] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:20.709547 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0a28f-6b9f-4c4f-ae6a-3ef30d4d296d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.719661 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0a28f-6b9f-4c4f-ae6a-3ef30d4d296d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.725289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.725966 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.726240 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.726504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.727146 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.729592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:20.760084 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1323/2682] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:20 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:20.764611 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.782106 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7e91-7acb-4968-a7af-45749f9bbe7b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.849682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.850283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.850559 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.850828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.851471 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.853356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:20.862278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:20.880551 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1360/2683] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:20 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:20.881648 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.893942 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a1dc1-8c87-4afe-afea-e367b99f25ef admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.898752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.899353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.899664 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.899941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.900595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.902741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:20.914604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1324/2684] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:20.919398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.930606 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289fe18-a59e-4686-8e38-be8e14c3dee8 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.935709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7133f99-9558-488a-b6ef-ef171e3d81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.936304 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133f99-9558-488a-b6ef-ef171e3d81f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.936653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133f99-9558-488a-b6ef-ef171e3d81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.936922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7133f99-9558-488a-b6ef-ef171e3d81f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.937635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7133f99-9558-488a-b6ef-ef171e3d81f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.939401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7133f99-9558-488a-b6ef-ef171e3d81f6 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:20.954895 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1361/2685] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:20.958462 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:20.971773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62955-1294-4ea8-9569-21e35d63828b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:20.976979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:20.977860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:20.978132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:20.978397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] PATH_INFO: `/v3/projects/b66c6c384b554224acc5481376b9d9d3/users/f7362020fb5041db942d0235a3fe8ef7/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:20.994836 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66c6c384b554224acc5481376b9d9d3, user_id=f7362020fb5041db942d0235a3fe8ef7, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:20.997653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:21.011623 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1325/2686] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:20 2022] PUT /identity/v3/projects/b66c6c384b554224acc5481376b9d9d3/users/f7362020fb5041db942d0235a3fe8ef7/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:21.021488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3c2b3-f78e-476d-99b3-bbddc65a1ae1 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:21.021820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3c2b3-f78e-476d-99b3-bbddc65a1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:21.022093 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3c2b3-f78e-476d-99b3-bbddc65a1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:21.053268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-26c3c2b3-f78e-476d-99b3-bbddc65a1ae1 None None] MFA Rules not processed for user `f7362020fb5041db942d0235a3fe8ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:21.054511 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-26c3c2b3-f78e-476d-99b3-bbddc65a1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:21.116652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1362/2687] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:21.127379 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:21.129061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:21.187109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c5063-2b31-4a54-946c-835c61e4fc09 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:21.190655 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa77ec9b56cd4027b22fbe0d7ff3ee1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:21.191252 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:21.191527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:21.191795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:21.199936 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:21.201337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:21.210021 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1326/2688] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:22.253359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:22.253893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:22.253989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:22.273136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:22.274376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:22.328757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1363/2689] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:23:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:22.341249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:22.342678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:22.402205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:22.418659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001860b8-12a2-4e56-aa3e-8a9ce2a26eb0 service glance] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:22.425495 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:22.426248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:22.426546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:22.426816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:22.437237 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:22.438886 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:22.448439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1327/2690] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:23:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:23.412760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:23.414362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:23.487994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51cb8b-cba9-46ec-b15a-ce0396e45da0 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:23.491638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306d468-dcbb-4337-9c4f-06678bc009ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:23.492242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306d468-dcbb-4337-9c4f-06678bc009ba service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:23.492520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306d468-dcbb-4337-9c4f-06678bc009ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:23.492791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306d468-dcbb-4337-9c4f-06678bc009ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:23.494633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a306d468-dcbb-4337-9c4f-06678bc009ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:23.530040 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:23.568352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306d468-dcbb-4337-9c4f-06678bc009ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:23.569808 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306d468-dcbb-4337-9c4f-06678bc009ba service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:23.580047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1364/2691] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:26.096426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:26.098051 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:26.198205 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b7233-d9ae-44aa-8b7e-663205245fdf service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:26.203055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:26.203888 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:26.204168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:26.204445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] PATH_INFO: `/v3/users/11ef14ec9d0c4637ad3f5e3ccfddfb08` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:26.205679 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ef14ec9d0c4637ad3f5e3ccfddfb08)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:26.207636 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:26.268056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ef14ec9d0c4637ad3f5e3ccfddfb08'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:26.269181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ef14ec9d0c4637ad3f5e3ccfddfb08'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:26.277298 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ef14ec9d0c4637ad3f5e3ccfddfb08'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:26.286168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ef14ec9d0c4637ad3f5e3ccfddfb08'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:26.290003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ef14ec9d0c4637ad3f5e3ccfddfb08'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:26.310969 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1328/2692] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:26 2022] DELETE /identity/v3/users/11ef14ec9d0c4637ad3f5e3ccfddfb08 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:26.315778 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:26.316268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:26.316684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:26.348527 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:26.350457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:26.425353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1365/2693] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:26.435585 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:26.437177 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:26.503210 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33099f-9166-4c2e-9811-210bbde66d06 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:26.506977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:26.507653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:26.507995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:26.508347 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:26.519016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:26.520593 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:26.532145 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1329/2694] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:26.918222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:26.922757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:26.947072 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d0fb3-7110-478a-b1e1-629db30d86bb None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:26.953325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:26.953325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:26.953655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:26.953759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] PATH_INFO: `/v3/projects/69b59427f787416eb7e22966f6ec74bc` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:26.954842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b59427f787416eb7e22966f6ec74bc)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:26.960892 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:27.036417 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b59427f787416eb7e22966f6ec74bc', 'request_id': 'req-7f82d662-c4d7-4627-9836-7e21f9615391'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.043405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b59427f787416eb7e22966f6ec74bc', 'request_id': 'req-7f82d662-c4d7-4627-9836-7e21f9615391'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.055260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b59427f787416eb7e22966f6ec74bc', 'request_id': 'req-7f82d662-c4d7-4627-9836-7e21f9615391'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.067293 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] The token cache is being invalidate because project 69b59427f787416eb7e22966f6ec74bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:27.067939 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.068828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.070840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1366/2695] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:26 2022] DELETE /identity/v3/projects/69b59427f787416eb7e22966f6ec74bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:27.075645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:27.089171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f17cc9-93e2-4b04-b3db-ef12a855a567 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:27.094337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:27.160441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:27.161182 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:27.161473 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:27.161805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] PATH_INFO: `/v3/users/7fa9279910264af8b881e7e548cdd25a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:27.162955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa9279910264af8b881e7e548cdd25a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:27.165275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:27.223194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa9279910264af8b881e7e548cdd25a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.224729 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa9279910264af8b881e7e548cdd25a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.233148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa9279910264af8b881e7e548cdd25a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.242738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa9279910264af8b881e7e548cdd25a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.243499 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa9279910264af8b881e7e548cdd25a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.264610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1330/2696] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:27 2022] DELETE /identity/v3/users/7fa9279910264af8b881e7e548cdd25a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:27.645402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:27.647727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:27.662837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d662-c4d7-4627-9836-7e21f9615391 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:27.738459 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:27.751197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:27.752167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:27.752746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:27.753179 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] PATH_INFO: `/v3/projects/8ee0d26f4b6c4022a03c002da2777e75` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:27.754531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee0d26f4b6c4022a03c002da2777e75)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:27.756629 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:27.817414 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee0d26f4b6c4022a03c002da2777e75', 'request_id': 'req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.826207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee0d26f4b6c4022a03c002da2777e75', 'request_id': 'req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.835575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee0d26f4b6c4022a03c002da2777e75', 'request_id': 'req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.851484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] The token cache is being invalidate because project 8ee0d26f4b6c4022a03c002da2777e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:27.851977 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.852926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:27.855981 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1367/2697] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:27 2022] DELETE /identity/v3/projects/8ee0d26f4b6c4022a03c002da2777e75 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:27.861937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:27.863909 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:27.891236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393889d-5bac-4150-a0d7-6c597350eadf admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:28.002891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:28.003374 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:28.003733 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:28.003951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] PATH_INFO: `/v3/users/011020b4d79d4f4b8080fc4b6bf1b34a` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:28.006294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011020b4d79d4f4b8080fc4b6bf1b34a)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:28.008740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:28.066604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:28.086263 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011020b4d79d4f4b8080fc4b6bf1b34a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.087516 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011020b4d79d4f4b8080fc4b6bf1b34a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.115801 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011020b4d79d4f4b8080fc4b6bf1b34a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.140800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011020b4d79d4f4b8080fc4b6bf1b34a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.141640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-6487d749-d49d-40a6-9652-c0569c30de73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011020b4d79d4f4b8080fc4b6bf1b34a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.162931 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1331/2698] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:27 2022] DELETE /identity/v3/users/011020b4d79d4f4b8080fc4b6bf1b34a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:28.480332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:28.482130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:28.501279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac3cd-d823-4bbc-9035-c38eb2b3c9f0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:28.591568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:28.592299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:28.595056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:28.595056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] PATH_INFO: `/v3/projects/cb53d5df449e44ea94be92d52dcd45a2` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:28.596371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb53d5df449e44ea94be92d52dcd45a2)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:28.598389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:28.720430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb53d5df449e44ea94be92d52dcd45a2', 'request_id': 'req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.746748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb53d5df449e44ea94be92d52dcd45a2', 'request_id': 'req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.761274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb53d5df449e44ea94be92d52dcd45a2', 'request_id': 'req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.777013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] The token cache is being invalidate because project cb53d5df449e44ea94be92d52dcd45a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:28.777302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.777993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-54b3d86a-01e2-4d8e-95f3-bc1b961c71c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:28.779693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1368/2699] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:28 2022] DELETE /identity/v3/projects/cb53d5df449e44ea94be92d52dcd45a2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:28.785999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852c13-0c8a-4254-b4d1-ebb75f7c4f1b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:28.786288 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852c13-0c8a-4254-b4d1-ebb75f7c4f1b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:28.786566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852c13-0c8a-4254-b4d1-ebb75f7c4f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:28.825833 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6e852c13-0c8a-4254-b4d1-ebb75f7c4f1b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:28.827293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6e852c13-0c8a-4254-b4d1-ebb75f7c4f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:28.914842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1332/2700] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:28.923380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0036a8-44f7-4670-b32c-9d90ba8c57ce None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:28.923888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0036a8-44f7-4670-b32c-9d90ba8c57ce None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:28.924249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0036a8-44f7-4670-b32c-9d90ba8c57ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:28.948764 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9c0036a8-44f7-4670-b32c-9d90ba8c57ce None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:28.950205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9c0036a8-44f7-4670-b32c-9d90ba8c57ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:28.958930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1369/2701] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:28.963389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e852c13-0c8a-4254-b4d1-ebb75f7c4f1b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:28.976606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e852c13-0c8a-4254-b4d1-ebb75f7c4f1b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:28.982003 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:28.983030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:28.983412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:28.983793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:28.984904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:28.985343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:28.987279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.000834 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1333/2702] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:23:29.005024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0036a8-44f7-4670-b32c-9d90ba8c57ce None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.011430 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:29.015585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0036a8-44f7-4670-b32c-9d90ba8c57ce None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.027396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.028096 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.028437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.028789 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.029494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.031552 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.065554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1370/2703] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:29 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:29.068055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.080236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a6ce-1226-427a-abaa-8b6d1247feda admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.164721 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.167316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.167906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.168606 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.170043 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.172348 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.206486 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1334/2704] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:29 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:29.210754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.226349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28a803-c5b3-4677-9937-cd4104bc001a admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.249958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.250829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.251220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.251822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.252860 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.254837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.270679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1371/2705] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:29.277999 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.292063 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451ef3-4916-455b-b931-b2ac6a63f92b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.298849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72773f69-9d13-4774-bd25-583eee4e7091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.299829 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773f69-9d13-4774-bd25-583eee4e7091 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.300363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773f69-9d13-4774-bd25-583eee4e7091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.300860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72773f69-9d13-4774-bd25-583eee4e7091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.302140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72773f69-9d13-4774-bd25-583eee4e7091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.304582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72773f69-9d13-4774-bd25-583eee4e7091 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.319778 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1335/2706] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:29.342708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.358207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e78f8f-48b1-493b-85fd-1634f6b7d8fd admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.363926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.364593 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.364930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.365130 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] PATH_INFO: `/v3/projects/5c7ce47c98a94e51856c36616889e68d/users/932c30def9a84b04b6218cdce8d31a51/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.382287 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7ce47c98a94e51856c36616889e68d, user_id=932c30def9a84b04b6218cdce8d31a51, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.384926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.399529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1372/2707] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:29 2022] PUT /identity/v3/projects/5c7ce47c98a94e51856c36616889e68d/users/932c30def9a84b04b6218cdce8d31a51/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:29.413011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706738b-bad7-47c7-9976-268c3b3f1602 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.413292 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706738b-bad7-47c7-9976-268c3b3f1602 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.413629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706738b-bad7-47c7-9976-268c3b3f1602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.440898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:29.445115 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5706738b-bad7-47c7-9976-268c3b3f1602 None None] MFA Rules not processed for user `932c30def9a84b04b6218cdce8d31a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:29.447186 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5706738b-bad7-47c7-9976-268c3b3f1602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:29.522920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1336/2708] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:29.528045 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.605623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5dba1-6404-45bb-a4da-048931252e06 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.610427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.611103 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.611474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.611797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.612502 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.614501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.650086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1373/2709] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:29 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:29.654280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706738b-bad7-47c7-9976-268c3b3f1602 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.667266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706738b-bad7-47c7-9976-268c3b3f1602 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.746164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.747164 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.747520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.747864 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.748579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.750633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.780732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1337/2710] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:29 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:29.781536 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.791836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef2235-0b4b-4e7f-8375-c5929118d60f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.796462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.797048 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.797318 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.797610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.798242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.799804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.811814 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1374/2711] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:29.815989 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.827453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f4ca-7a6a-4fd9-9a8a-47560bb4c701 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.832175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.832827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.833109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.833567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] PATH_INFO: `/v3/projects/1352f840f24e4c4a8d144bb4420c6c0f/users/bd7e4910518e452695abae3d32d6a65c/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.858207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1352f840f24e4c4a8d144bb4420c6c0f, user_id=bd7e4910518e452695abae3d32d6a65c, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.861388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.878136 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1338/2712] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:29 2022] PUT /identity/v3/projects/1352f840f24e4c4a8d144bb4420c6c0f/users/bd7e4910518e452695abae3d32d6a65c/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:29.881993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.894310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326733-3d02-476f-a14c-b36540d2d87c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.964242 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1ba5-65fa-4187-98ea-46c1e9064032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.964950 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1ba5-65fa-4187-98ea-46c1e9064032 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.965301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1ba5-65fa-4187-98ea-46c1e9064032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.965595 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1ba5-65fa-4187-98ea-46c1e9064032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.966239 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1ba5-65fa-4187-98ea-46c1e9064032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.968099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1ba5-65fa-4187-98ea-46c1e9064032 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.982548 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1375/2713] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:29.986879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.001239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e98df3-72ba-497e-9664-6953d34d6d07 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.006040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.006700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.006977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.007247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] PATH_INFO: `/v3/projects/1352f840f24e4c4a8d144bb4420c6c0f/users/bd7e4910518e452695abae3d32d6a65c/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.009206 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1352f840f24e4c4a8d144bb4420c6c0f, user_id=bd7e4910518e452695abae3d32d6a65c, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.011918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.023858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1339/2714] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:29 2022] PUT /identity/v3/projects/1352f840f24e4c4a8d144bb4420c6c0f/users/bd7e4910518e452695abae3d32d6a65c/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:30.037788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339dc2-3018-4e2e-a7d8-2061098f9e4e None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.037788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339dc2-3018-4e2e-a7d8-2061098f9e4e None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.037788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d339dc2-3018-4e2e-a7d8-2061098f9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.068951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-6d339dc2-3018-4e2e-a7d8-2061098f9e4e None None] MFA Rules not processed for user `bd7e4910518e452695abae3d32d6a65c`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:30.070299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-6d339dc2-3018-4e2e-a7d8-2061098f9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:30.076525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:30.162286 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1376/2715] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:30.174738 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.176980 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:30.244958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5916-421c-4193-b7e3-d8d1107cce19 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.254563 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b2bc-e8d6-46ca-b116-f30fb6fb2f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.255405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b2bc-e8d6-46ca-b116-f30fb6fb2f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.255927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b2bc-e8d6-46ca-b116-f30fb6fb2f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.256295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b2bc-e8d6-46ca-b116-f30fb6fb2f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.268431 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b2bc-e8d6-46ca-b116-f30fb6fb2f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.270055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b2bc-e8d6-46ca-b116-f30fb6fb2f05 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.274734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:30.283178 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1340/2716] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:30.740186 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339dc2-3018-4e2e-a7d8-2061098f9e4e None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.801962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d339dc2-3018-4e2e-a7d8-2061098f9e4e None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.806665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.807363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.808160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.808429 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] PATH_INFO: `/v3/users/932c30def9a84b04b6218cdce8d31a51` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.809556 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=932c30def9a84b04b6218cdce8d31a51)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.811442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.860278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932c30def9a84b04b6218cdce8d31a51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.860836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932c30def9a84b04b6218cdce8d31a51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.872987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932c30def9a84b04b6218cdce8d31a51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.879779 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932c30def9a84b04b6218cdce8d31a51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.880404 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932c30def9a84b04b6218cdce8d31a51'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.893440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1377/2717] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:30 2022] DELETE /identity/v3/users/932c30def9a84b04b6218cdce8d31a51 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:30.898542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.899181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.899417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.919006 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:30.920229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:30.978657 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1341/2718] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:30.988914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.990326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:31.018974 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:31.054904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01382-e3c3-4ad0-a5a2-79d31c712c5c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:31.058028 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:31.058637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:31.058911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:31.059204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:31.068679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:31.070165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:31.079537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1378/2719] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:31.368712 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:31.370471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:31.382546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f4ae8-4378-4529-bb69-66c64e74e381 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:31.387741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:31.388453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:31.388793 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:31.389125 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] PATH_INFO: `/v3/projects/5c7ce47c98a94e51856c36616889e68d` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:31.390405 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7ce47c98a94e51856c36616889e68d)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:31.392360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:31.444848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7ce47c98a94e51856c36616889e68d', 'request_id': 'req-0005285a-3a22-462a-98e8-2e9e87536ca4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.454202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7ce47c98a94e51856c36616889e68d', 'request_id': 'req-0005285a-3a22-462a-98e8-2e9e87536ca4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.460080 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7ce47c98a94e51856c36616889e68d', 'request_id': 'req-0005285a-3a22-462a-98e8-2e9e87536ca4'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.471995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] The token cache is being invalidate because project 5c7ce47c98a94e51856c36616889e68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:31.472277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.472922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.474496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1342/2720] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:31 2022] DELETE /identity/v3/projects/5c7ce47c98a94e51856c36616889e68d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:31.478494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:31.488390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7099f-031e-4eed-878b-b9a281ededd6 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:31.545696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:31.546392 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:31.546898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:31.547205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] PATH_INFO: `/v3/users/bd7e4910518e452695abae3d32d6a65c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:31.548323 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7e4910518e452695abae3d32d6a65c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:31.550263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:31.611173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7e4910518e452695abae3d32d6a65c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.612056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7e4910518e452695abae3d32d6a65c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.624302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7e4910518e452695abae3d32d6a65c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.631422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7e4910518e452695abae3d32d6a65c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.632222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-19d0a536-afe3-4656-8a9f-9ca862695e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7e4910518e452695abae3d32d6a65c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:31.646245 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1379/2721] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:31 2022] DELETE /identity/v3/users/bd7e4910518e452695abae3d32d6a65c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:32.227074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:32.228535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:32.257268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005285a-3a22-462a-98e8-2e9e87536ca4 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:32.318264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:32.318892 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.319170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.319441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] PATH_INFO: `/v3/projects/1352f840f24e4c4a8d144bb4420c6c0f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.320556 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1352f840f24e4c4a8d144bb4420c6c0f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:32.322515 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:32.347074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:32.372861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1352f840f24e4c4a8d144bb4420c6c0f', 'request_id': 'req-146bc345-9e60-4770-96d5-74c7a4d43ae7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:32.383410 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1352f840f24e4c4a8d144bb4420c6c0f', 'request_id': 'req-146bc345-9e60-4770-96d5-74c7a4d43ae7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:32.389700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1352f840f24e4c4a8d144bb4420c6c0f', 'request_id': 'req-146bc345-9e60-4770-96d5-74c7a4d43ae7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:32.400854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] The token cache is being invalidate because project 1352f840f24e4c4a8d144bb4420c6c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:32.401143 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:32.401826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-146bc345-9e60-4770-96d5-74c7a4d43ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:32.403325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1343/2722] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:32 2022] DELETE /identity/v3/projects/1352f840f24e4c4a8d144bb4420c6c0f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:32.408607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b120-37fb-43c3-a592-ac208c26d87f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.409081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b120-37fb-43c3-a592-ac208c26d87f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.409183 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b120-37fb-43c3-a592-ac208c26d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.432227 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-f2e1b120-37fb-43c3-a592-ac208c26d87f None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:32.433970 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f2e1b120-37fb-43c3-a592-ac208c26d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:32.473033 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:32.494110 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1380/2723] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:32.502287 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b94a6-ccd6-4fbb-a938-61af93af4a52 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.502635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b94a6-ccd6-4fbb-a938-61af93af4a52 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.502913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b94a6-ccd6-4fbb-a938-61af93af4a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.522275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-a48b94a6-ccd6-4fbb-a938-61af93af4a52 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:32.523468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-a48b94a6-ccd6-4fbb-a938-61af93af4a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:32.531837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1344/2724] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:32.536627 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b120-37fb-43c3-a592-ac208c26d87f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:32.548024 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b120-37fb-43c3-a592-ac208c26d87f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:32.552603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:32.553190 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.553463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.553757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.554386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:32.554696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:32.556240 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:32.567804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1381/2725] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:32.572165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b94a6-ccd6-4fbb-a938-61af93af4a52 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:32.582244 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b94a6-ccd6-4fbb-a938-61af93af4a52 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:32.587681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:32.589233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.589610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.589962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.590654 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:32.592686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:32.622540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1345/2726] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:32 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:32.626665 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:32.636923 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dbe91-179b-447c-b713-2e6e0566916e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:32.698672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:32.699313 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.699885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.700182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.700958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:32.702713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:32.724358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1382/2727] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:32 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:32.728506 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:32.739250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa169-c69c-4769-9c00-884b4a187d03 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:32.744304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:32.745432 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.745739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.746008 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.746704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:32.748295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:32.759017 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1346/2728] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:32.763088 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:32.773089 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7bb08-9d5d-4f7f-bd94-ab9ac986eda1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:32.777743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189770f8-2623-42f5-ae86-e8c012dc3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:32.778330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189770f8-2623-42f5-ae86-e8c012dc3cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.778602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189770f8-2623-42f5-ae86-e8c012dc3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.778866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189770f8-2623-42f5-ae86-e8c012dc3cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.779494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189770f8-2623-42f5-ae86-e8c012dc3cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:32.781039 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189770f8-2623-42f5-ae86-e8c012dc3cf8 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:32.791819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1383/2729] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:32.796067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:32.805759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68438758-8bb6-4447-a67b-b2dd71b738a5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:32.811187 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:32.811825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.812103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.812373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] PATH_INFO: `/v3/projects/2f1d6af17cae44c0b05212c53c9477ac/users/de40ed39255e48c7a211adb2847521e2/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.827540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1d6af17cae44c0b05212c53c9477ac, user_id=de40ed39255e48c7a211adb2847521e2, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:32.830220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:32.843299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1347/2730] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:32 2022] PUT /identity/v3/projects/2f1d6af17cae44c0b05212c53c9477ac/users/de40ed39255e48c7a211adb2847521e2/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:32.854546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798d4f1-9ee7-4b70-8282-a9cab41e0b42 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:32.854829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798d4f1-9ee7-4b70-8282-a9cab41e0b42 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:32.855100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798d4f1-9ee7-4b70-8282-a9cab41e0b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:32.882560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3798d4f1-9ee7-4b70-8282-a9cab41e0b42 None None] MFA Rules not processed for user `de40ed39255e48c7a211adb2847521e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:32.883776 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3798d4f1-9ee7-4b70-8282-a9cab41e0b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:32.946340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1384/2731] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:32.950774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.013243 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cacbf8-0fce-49c0-957c-5ed12e65c7f4 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.018875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.019918 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.020198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.020468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.021110 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.023121 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.053663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1348/2732] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:32 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:33.055165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798d4f1-9ee7-4b70-8282-a9cab41e0b42 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.066505 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798d4f1-9ee7-4b70-8282-a9cab41e0b42 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.106589 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:33.125811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.126409 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.126680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.126943 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.127574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.129444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.151888 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1385/2733] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:33 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:33.155844 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.168640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53e82-8658-451c-ba55-229dbe4d7ebc admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.173701 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.174316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.174597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.174869 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.175519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.177105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.191336 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1349/2734] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:33.192503 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.202612 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716f8b7-8fb2-4698-8e85-d42ccf37fb9c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.207334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d110a-9a8f-4812-ad11-5593d4194e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.207929 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d110a-9a8f-4812-ad11-5593d4194e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.208210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d110a-9a8f-4812-ad11-5593d4194e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.208480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d110a-9a8f-4812-ad11-5593d4194e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.209117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d110a-9a8f-4812-ad11-5593d4194e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.210708 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d110a-9a8f-4812-ad11-5593d4194e9f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.221299 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1386/2735] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:33.225626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.237761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2aaf54-ec14-4bba-a118-56bdb92f6729 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.242404 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.243046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.243324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.243596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] PATH_INFO: `/v3/projects/ee07c89bff4e4ab582f6c44215e41123/users/e6a82f274ce64cf283f2ac88b054dffb/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.259319 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee07c89bff4e4ab582f6c44215e41123, user_id=e6a82f274ce64cf283f2ac88b054dffb, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.262526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.270181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:33.277065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1350/2736] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:33 2022] PUT /identity/v3/projects/ee07c89bff4e4ab582f6c44215e41123/users/e6a82f274ce64cf283f2ac88b054dffb/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:33.288340 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1ba32-aee0-4069-8241-af7d4d2fff9d None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.288623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1ba32-aee0-4069-8241-af7d4d2fff9d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.288916 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1ba32-aee0-4069-8241-af7d4d2fff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.319379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-9ac1ba32-aee0-4069-8241-af7d4d2fff9d None None] MFA Rules not processed for user `e6a82f274ce64cf283f2ac88b054dffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:33.320488 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-9ac1ba32-aee0-4069-8241-af7d4d2fff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:33.384054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1387/2737] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:33.389081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.452055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e45d6-7fc1-432b-af76-3210b52f4783 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.456797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.457400 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.457709 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.457982 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.458620 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.460494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.487291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1351/2738] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:33 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:33.490870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1ba32-aee0-4069-8241-af7d4d2fff9d None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.502042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1ba32-aee0-4069-8241-af7d4d2fff9d None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.558144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.558746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.559018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.559283 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.559906 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.561834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.585657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1388/2739] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:33 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:33.589889 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.601609 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508b83c-cf1b-4569-aa11-ba0eaea70409 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.606224 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.606832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.607126 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.607376 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.608016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.609723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.621069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1352/2740] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:33.625213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.635220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878b9e8-2717-49be-86e1-2371d3494ea0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.640507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.641153 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.641428 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.641841 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] PATH_INFO: `/v3/projects/7ea9d055589a49e8bac5aecaa7c50941/users/7a87954d12fa400686c0ace5fdd45c33/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.657476 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea9d055589a49e8bac5aecaa7c50941, user_id=7a87954d12fa400686c0ace5fdd45c33, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.660168 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.674853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1389/2741] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:33 2022] PUT /identity/v3/projects/7ea9d055589a49e8bac5aecaa7c50941/users/7a87954d12fa400686c0ace5fdd45c33/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:33.678941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.689791 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fab7-10fc-4c49-ad2b-01b60cc66df8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.755684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6767e-f4bc-444f-8457-5e28826088d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.756330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6767e-f4bc-444f-8457-5e28826088d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.756658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6767e-f4bc-444f-8457-5e28826088d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.756938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6767e-f4bc-444f-8457-5e28826088d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.757622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6767e-f4bc-444f-8457-5e28826088d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.759447 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6767e-f4bc-444f-8457-5e28826088d9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.769832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1353/2742] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:33.774220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.784481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f533-30bb-4f31-9953-eb56703c6518 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:33.789013 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:33.789691 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.790042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.790310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] PATH_INFO: `/v3/projects/7ea9d055589a49e8bac5aecaa7c50941/users/7a87954d12fa400686c0ace5fdd45c33/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.792829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea9d055589a49e8bac5aecaa7c50941, user_id=7a87954d12fa400686c0ace5fdd45c33, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:33.795494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:33.802306 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:33.808157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1390/2743] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:33 2022] PUT /identity/v3/projects/7ea9d055589a49e8bac5aecaa7c50941/users/7a87954d12fa400686c0ace5fdd45c33/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:33.818645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:33.819184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:33.819519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:33.852113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] MFA Rules not processed for user `7a87954d12fa400686c0ace5fdd45c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:33.853553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:33.925359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:33.936308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1354/2744] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:33.948373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:33.950155 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:34.009204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d6f51-cdb3-429e-8526-d7b4be83a0b1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:34.012865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:34.013453 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:34.013757 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:34.014016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:34.070834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:34.072257 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:34.081221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1391/2745] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:35.639507 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:35.640935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:35.654294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95849d-fab0-4e2f-9a66-b65e54bf4f1f None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:35.658592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:35.659291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:35.659570 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:35.659843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:35.717767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:35.719267 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:35.731032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1355/2746] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:36.334171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:36.343161 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58de054-8595-47cc-b85d-7adbfa0f6033 service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:36.346914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35831e5-7b7b-4a6a-b9fa-fb589becee58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:36.347512 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35831e5-7b7b-4a6a-b9fa-fb589becee58 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:36.347813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35831e5-7b7b-4a6a-b9fa-fb589becee58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:36.348059 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35831e5-7b7b-4a6a-b9fa-fb589becee58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:36.357325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35831e5-7b7b-4a6a-b9fa-fb589becee58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:36.358997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35831e5-7b7b-4a6a-b9fa-fb589becee58 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:36.370532 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1392/2747] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:36.982096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:36.983492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.047905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f5106-767a-4f22-86cb-90c981c62935 service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:37.052318 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:37.052941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.053217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.053492 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] PATH_INFO: `/v3/users/f7362020fb5041db942d0235a3fe8ef7` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.054640 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7362020fb5041db942d0235a3fe8ef7)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:37.056539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:37.101445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7362020fb5041db942d0235a3fe8ef7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.102118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7362020fb5041db942d0235a3fe8ef7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.109372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7362020fb5041db942d0235a3fe8ef7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.116693 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7362020fb5041db942d0235a3fe8ef7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.117322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7362020fb5041db942d0235a3fe8ef7'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.134180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1356/2748] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:36 2022] DELETE /identity/v3/users/f7362020fb5041db942d0235a3fe8ef7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:37.138582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.138870 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.139140 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.158908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:37.160097 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.218731 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1393/2749] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:37.228341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:37.230268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.244510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:37.289624 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d2c28-6178-410e-8947-570ba5495281 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:37.293928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00b6e6-f5f7-48c3-84ff-e7781f1eaec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:37.294521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00b6e6-f5f7-48c3-84ff-e7781f1eaec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.294799 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00b6e6-f5f7-48c3-84ff-e7781f1eaec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.295066 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00b6e6-f5f7-48c3-84ff-e7781f1eaec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.310992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00b6e6-f5f7-48c3-84ff-e7781f1eaec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:37.312354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00b6e6-f5f7-48c3-84ff-e7781f1eaec1 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:37.322140 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1357/2750] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:37.602796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:37.604296 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.616267 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e8cf4-6c46-4b9c-a260-e4318408e314 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:37.621361 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:37.623099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.623333 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.623499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] PATH_INFO: `/v3/projects/b66c6c384b554224acc5481376b9d9d3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.624759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66c6c384b554224acc5481376b9d9d3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:37.626688 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:37.673157 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:37.684357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66c6c384b554224acc5481376b9d9d3', 'request_id': 'req-7a8f876b-bec8-4190-893f-10ceafca27fd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.691561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66c6c384b554224acc5481376b9d9d3', 'request_id': 'req-7a8f876b-bec8-4190-893f-10ceafca27fd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.700882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66c6c384b554224acc5481376b9d9d3', 'request_id': 'req-7a8f876b-bec8-4190-893f-10ceafca27fd'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.714652 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] The token cache is being invalidate because project b66c6c384b554224acc5481376b9d9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:37.714945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.715771 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7a8f876b-bec8-4190-893f-10ceafca27fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:37.717465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1394/2751] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:37 2022] DELETE /identity/v3/projects/b66c6c384b554224acc5481376b9d9d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:37.722605 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fb271-ae54-4af4-a2f5-3807fb563590 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.722890 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fb271-ae54-4af4-a2f5-3807fb563590 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.723161 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fb271-ae54-4af4-a2f5-3807fb563590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.754545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-082fb271-ae54-4af4-a2f5-3807fb563590 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:37.756060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-082fb271-ae54-4af4-a2f5-3807fb563590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.826387 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1358/2752] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:37.834749 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef502-d6cb-4edd-a55c-0376eaf5cea8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.835119 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef502-d6cb-4edd-a55c-0376eaf5cea8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.835294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef502-d6cb-4edd-a55c-0376eaf5cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.858802 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2aeef502-d6cb-4edd-a55c-0376eaf5cea8 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:37.860063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2aeef502-d6cb-4edd-a55c-0376eaf5cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:37.868960 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1395/2753] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:37.873856 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fb271-ae54-4af4-a2f5-3807fb563590 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:37.883784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fb271-ae54-4af4-a2f5-3807fb563590 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:37.889060 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:37.889767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.890116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.890454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.891169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:37.891536 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:37.893170 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:37.905247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1359/2754] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:23:37.909626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeef502-d6cb-4edd-a55c-0376eaf5cea8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:37.919077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeef502-d6cb-4edd-a55c-0376eaf5cea8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:37.923868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33dc5d-15dd-47b5-b838-cac1b30f1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:37.924463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33dc5d-15dd-47b5-b838-cac1b30f1d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:37.924748 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33dc5d-15dd-47b5-b838-cac1b30f1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:37.925036 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33dc5d-15dd-47b5-b838-cac1b30f1d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:37.925822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33dc5d-15dd-47b5-b838-cac1b30f1d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:37.927709 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33dc5d-15dd-47b5-b838-cac1b30f1d7e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:37.957797 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1396/2755] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:37 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:37.961951 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:37.975543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b745b8-c07f-441e-bdfe-f3ef07839045 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:38.034090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:38.034809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.035093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.035361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.035984 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:38.037922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:38.048633 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4eece-02eb-433e-a239-d70c5ef81154 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.048949 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4eece-02eb-433e-a239-d70c5ef81154 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.049483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4eece-02eb-433e-a239-d70c5ef81154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.061652 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1360/2756] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:37 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:38.065739 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:38.070788 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-3cf4eece-02eb-433e-a239-d70c5ef81154 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:38.071995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-3cf4eece-02eb-433e-a239-d70c5ef81154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:38.075726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf966e-3eee-49fd-8a30-6845a0f5e4fd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:38.080433 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:38.080958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.081235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.081519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.082194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:38.083754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:38.094470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1361/2757] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:38.098230 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:38.109286 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29f0e9-6453-494e-bbbf-d7ac03f5b1c9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:38.114628 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:38.117603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.117914 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.118388 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.119544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:38.121713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:38.129975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1397/2758] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 30 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:38.132117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1362/2759] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:38.136719 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4eece-02eb-433e-a239-d70c5ef81154 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:38.144700 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:38.147035 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:38.150614 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4eece-02eb-433e-a239-d70c5ef81154 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:38.156303 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578c6a0-44e3-4e4d-af22-21042a8d7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:38.156984 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578c6a0-44e3-4e4d-af22-21042a8d7db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.157264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578c6a0-44e3-4e4d-af22-21042a8d7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.157562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578c6a0-44e3-4e4d-af22-21042a8d7db9 admin admin] PATH_INFO: `/v3/projects/6721d9e0f0eb414eb4735d776afc472e/users/b35372419ac246a689156f2c8b68bcb4/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.157994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:38.175268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578c6a0-44e3-4e4d-af22-21042a8d7db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6721d9e0f0eb414eb4735d776afc472e, user_id=b35372419ac246a689156f2c8b68bcb4, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:38.177938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578c6a0-44e3-4e4d-af22-21042a8d7db9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:38.192469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1398/2760] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:38 2022] PUT /identity/v3/projects/6721d9e0f0eb414eb4735d776afc472e/users/b35372419ac246a689156f2c8b68bcb4/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:38.203049 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.203636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.203908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.223279 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63c19-0d83-4440-9e75-9a340ace9941 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:38.232277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] MFA Rules not processed for user `b35372419ac246a689156f2c8b68bcb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:38.233484 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:38.286924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:38.287535 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.287812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.288089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.298387 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1399/2761] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:38.310305 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:38.311643 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:38.321268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:38.349939 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:38.351548 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:38.360725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1363/2762] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:38.382165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acc52f-e0bf-45f4-b10b-17e510f569cf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:38.385930 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6fd84-7047-48f4-8eb0-e83edd721700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:38.386545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6fd84-7047-48f4-8eb0-e83edd721700 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.386822 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6fd84-7047-48f4-8eb0-e83edd721700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.387091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6fd84-7047-48f4-8eb0-e83edd721700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.396201 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6fd84-7047-48f4-8eb0-e83edd721700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:38.397654 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6fd84-7047-48f4-8eb0-e83edd721700 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:38.406831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1400/2763] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:40.296180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:40.297604 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:40.349283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=100 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:40.363392 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4f0a6-2841-478b-8ffa-a98ef63433d7 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:40.367979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:40.368597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:40.368933 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:40.369209 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] PATH_INFO: `/v3/users/de40ed39255e48c7a211adb2847521e2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:40.370853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de40ed39255e48c7a211adb2847521e2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:40.372806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:40.418681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de40ed39255e48c7a211adb2847521e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:40.419342 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de40ed39255e48c7a211adb2847521e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:40.426591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de40ed39255e48c7a211adb2847521e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:40.434241 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de40ed39255e48c7a211adb2847521e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:40.434981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de40ed39255e48c7a211adb2847521e2'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:40.452658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1364/2764] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:40 2022] DELETE /identity/v3/users/de40ed39255e48c7a211adb2847521e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:40.458188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:40.458717 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:40.458839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:40.477436 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:40.478659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:40.535982 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1401/2765] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:40.546056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:40.547448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:40.606723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe1aaf-b112-414f-8576-603802b22e6c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:40.610349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:40.610941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:40.611211 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:40.611475 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:40.621567 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:40.622975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:40.632573 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1365/2766] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:40.905636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:40.907175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:40.920766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8205-4c1a-4f33-8a82-cebb4c7d8880 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:40.925378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:40.926056 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:40.926302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:40.926576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] PATH_INFO: `/v3/projects/2f1d6af17cae44c0b05212c53c9477ac` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:40.927696 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1d6af17cae44c0b05212c53c9477ac)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:40.929610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:40.975890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1d6af17cae44c0b05212c53c9477ac', 'request_id': 'req-4a06d015-9ae8-4d10-b94d-64b406814690'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:40.982396 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1d6af17cae44c0b05212c53c9477ac', 'request_id': 'req-4a06d015-9ae8-4d10-b94d-64b406814690'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:40.989922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1d6af17cae44c0b05212c53c9477ac', 'request_id': 'req-4a06d015-9ae8-4d10-b94d-64b406814690'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.000642 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] The token cache is being invalidate because project 2f1d6af17cae44c0b05212c53c9477ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:41.000926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.001570 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.003377 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1402/2767] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:40 2022] DELETE /identity/v3/projects/2f1d6af17cae44c0b05212c53c9477ac => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:41.007299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:41.016985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2fa3-9d21-4655-8407-869bbfb6891b service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:41.071906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:41.072449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:41.072723 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:41.073108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] PATH_INFO: `/v3/users/e6a82f274ce64cf283f2ac88b054dffb` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:41.074242 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a82f274ce64cf283f2ac88b054dffb)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:41.076116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:41.091743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:41.122453 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a82f274ce64cf283f2ac88b054dffb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.123092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a82f274ce64cf283f2ac88b054dffb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.129877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a82f274ce64cf283f2ac88b054dffb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.137944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a82f274ce64cf283f2ac88b054dffb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.138559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a82f274ce64cf283f2ac88b054dffb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.156238 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1366/2768] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:41 2022] DELETE /identity/v3/users/e6a82f274ce64cf283f2ac88b054dffb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:41.442268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:41.443911 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:41.461569 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d015-9ae8-4d10-b94d-64b406814690 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:41.497078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:41.525460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:41.526113 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:41.526391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:41.526672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] PATH_INFO: `/v3/projects/ee07c89bff4e4ab582f6c44215e41123` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:41.527812 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee07c89bff4e4ab582f6c44215e41123)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:41.529723 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:41.575759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee07c89bff4e4ab582f6c44215e41123', 'request_id': 'req-7d55f253-4a02-436f-9f75-9d83c946567e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.581236 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee07c89bff4e4ab582f6c44215e41123', 'request_id': 'req-7d55f253-4a02-436f-9f75-9d83c946567e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.591836 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee07c89bff4e4ab582f6c44215e41123', 'request_id': 'req-7d55f253-4a02-436f-9f75-9d83c946567e'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.603544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] The token cache is being invalidate because project ee07c89bff4e4ab582f6c44215e41123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:41.603833 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.604463 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.605980 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1403/2769] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:41 2022] DELETE /identity/v3/projects/ee07c89bff4e4ab582f6c44215e41123 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:41.610457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:41.612054 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:41.626818 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0758-9592-40bf-b5cf-c315d2d957fe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:41.685235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:41.685895 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:41.686175 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:41.686442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] PATH_INFO: `/v3/users/7a87954d12fa400686c0ace5fdd45c33` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:41.687579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a87954d12fa400686c0ace5fdd45c33)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:41.689520 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:41.737116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a87954d12fa400686c0ace5fdd45c33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.737816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a87954d12fa400686c0ace5fdd45c33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.744627 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a87954d12fa400686c0ace5fdd45c33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.754301 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a87954d12fa400686c0ace5fdd45c33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.754919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2d7e2285-fd3c-4b36-81da-d1a8ebd3778b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a87954d12fa400686c0ace5fdd45c33'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:41.772745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1367/2770] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:41 2022] DELETE /identity/v3/users/7a87954d12fa400686c0ace5fdd45c33 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:42.039468 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.040917 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:42.055111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55f253-4a02-436f-9f75-9d83c946567e admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.112877 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.113494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.113807 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.114077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] PATH_INFO: `/v3/projects/7ea9d055589a49e8bac5aecaa7c50941` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.115177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea9d055589a49e8bac5aecaa7c50941)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.117044 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.168701 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea9d055589a49e8bac5aecaa7c50941', 'request_id': 'req-dcd118de-f182-4472-8ead-446fb3b863ef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:42.174561 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea9d055589a49e8bac5aecaa7c50941', 'request_id': 'req-dcd118de-f182-4472-8ead-446fb3b863ef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:42.182021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea9d055589a49e8bac5aecaa7c50941', 'request_id': 'req-dcd118de-f182-4472-8ead-446fb3b863ef'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:42.183131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:42.197224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] The token cache is being invalidate because project 7ea9d055589a49e8bac5aecaa7c50941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:42.197598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:42.198160 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-dcd118de-f182-4472-8ead-446fb3b863ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:42.199637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1404/2771] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:42 2022] DELETE /identity/v3/projects/7ea9d055589a49e8bac5aecaa7c50941 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:42.204467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b0d92-8183-484a-815f-c37cb44e2588 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.204750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b0d92-8183-484a-815f-c37cb44e2588 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.205045 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b0d92-8183-484a-815f-c37cb44e2588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.224354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7f2b0d92-8183-484a-815f-c37cb44e2588 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:42.225578 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7f2b0d92-8183-484a-815f-c37cb44e2588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:42.234359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:42.285610 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1368/2772] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:42.294989 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f75a-8e2a-4784-b853-594fbab05284 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.295271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f75a-8e2a-4784-b853-594fbab05284 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.295543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919f75a-8e2a-4784-b853-594fbab05284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.314837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-e919f75a-8e2a-4784-b853-594fbab05284 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:42.316030 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e919f75a-8e2a-4784-b853-594fbab05284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:42.323885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1405/2773] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:42.327937 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b0d92-8183-484a-815f-c37cb44e2588 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.337442 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b0d92-8183-484a-815f-c37cb44e2588 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.342876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.343463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.343740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.344009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] PATH_INFO: `/v3/domains` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.344646 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81657) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:42.344947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.346559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.358767 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1369/2774] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:42.363831 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919f75a-8e2a-4784-b853-594fbab05284 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.373003 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919f75a-8e2a-4784-b853-594fbab05284 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.377635 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.378221 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.378495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.378763 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.379390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.381253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.408752 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1406/2775] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:42 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:42.412601 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.423294 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2cd4-1c83-4898-882b-0b4a2217a241 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.478932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.479527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.479803 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.480072 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.481313 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.483248 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.505037 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1370/2776] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:42 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:42.509081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.519685 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c96c-1777-4a18-8e27-2ca39a5f9e9b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.524374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.524998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.525278 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.525581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.526215 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.528291 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.538507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1407/2777] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:42.542219 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.553247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817c8c-cb2d-46f5-93b0-6c0c79ea6629 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.558314 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96845683-1d44-44e1-bed2-c7e3d621c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.559020 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845683-1d44-44e1-bed2-c7e3d621c532 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.559303 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845683-1d44-44e1-bed2-c7e3d621c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.559577 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845683-1d44-44e1-bed2-c7e3d621c532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.560217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96845683-1d44-44e1-bed2-c7e3d621c532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.561899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96845683-1d44-44e1-bed2-c7e3d621c532 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.581255 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1371/2778] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:42.582380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.593987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefe1c1-9205-4211-b23e-8b8e47bb11f9 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.598650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.599302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.599581 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.599850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] PATH_INFO: `/v3/projects/c65e530c45eb4cc0ba96ad00e74f9c12/users/9b7ec96679cb4af2934d403c6dc0a862/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.615469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65e530c45eb4cc0ba96ad00e74f9c12, user_id=9b7ec96679cb4af2934d403c6dc0a862, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.618129 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.639008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1408/2779] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:42 2022] PUT /identity/v3/projects/c65e530c45eb4cc0ba96ad00e74f9c12/users/9b7ec96679cb4af2934d403c6dc0a862/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:42.649052 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f1f3-eb51-484b-bcd2-bad362ae2087 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.649550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f1f3-eb51-484b-bcd2-bad362ae2087 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.649670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407f1f3-eb51-484b-bcd2-bad362ae2087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.678898 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3407f1f3-eb51-484b-bcd2-bad362ae2087 None None] MFA Rules not processed for user `9b7ec96679cb4af2934d403c6dc0a862`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:42.680088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3407f1f3-eb51-484b-bcd2-bad362ae2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:42.745189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1372/2780] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:42.756479 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.758276 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:42.816637 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65b3f7-ad66-459c-8a84-8569e5d8b5e5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.820272 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf137-ec72-4d06-a735-9492a85ad5fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.820857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf137-ec72-4d06-a735-9492a85ad5fd service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.821133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf137-ec72-4d06-a735-9492a85ad5fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.821402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf137-ec72-4d06-a735-9492a85ad5fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.830038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf137-ec72-4d06-a735-9492a85ad5fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.831439 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf137-ec72-4d06-a735-9492a85ad5fd service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.841205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1409/2781] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:44.199041 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:44.200118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:44.200118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:44.219697 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] MFA Rules not processed for user `9b7ec96679cb4af2934d403c6dc0a862`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:44.220928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:44.227742 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1373/2782] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:23:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:52.836279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:54.213191 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:00.261398 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029ddb-d3fe-4623-a9fb-de73bef01d67 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.261853 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029ddb-d3fe-4623-a9fb-de73bef01d67 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.261953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029ddb-d3fe-4623-a9fb-de73bef01d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.281499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a9029ddb-d3fe-4623-a9fb-de73bef01d67 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:00.282742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a9029ddb-d3fe-4623-a9fb-de73bef01d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.336679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1410/2783] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:00.349857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.351262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.421822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed264-4cca-40a2-a4e9-ee6e0d5bbb0e None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.427034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.427641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.427921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.428223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.436510 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.438122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.445955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1374/2784] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:00.940857 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407016e-223f-4552-ae07-365afd043287 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.941188 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407016e-223f-4552-ae07-365afd043287 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.941492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407016e-223f-4552-ae07-365afd043287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.961109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a407016e-223f-4552-ae07-365afd043287 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:00.962350 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a407016e-223f-4552-ae07-365afd043287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.970804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1411/2785] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 30 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:24:00.982596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.993247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e96a-8138-4359-8f35-5e2869716e0f service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.998412 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.999531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.999806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.000078 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.008366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:01.009971 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:01.019299 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1375/2786] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:01.243824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfe35c-91c3-4a65-b5de-c764d4669b84 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.243824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfe35c-91c3-4a65-b5de-c764d4669b84 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.244520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfe35c-91c3-4a65-b5de-c764d4669b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.265725 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-97cfe35c-91c3-4a65-b5de-c764d4669b84 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:01.266910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-97cfe35c-91c3-4a65-b5de-c764d4669b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:01.275166 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1412/2787] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:01.288151 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:01.299734 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ea98f-4d9a-4678-bd88-36cd30901bb9 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:01.304804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:01.305558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.305840 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.306106 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.314919 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:01.316476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:01.324922 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1376/2788] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:24:01.639791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18430-6b02-4fea-aca4-df79e8293dc8 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.640104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18430-6b02-4fea-aca4-df79e8293dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.640337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f18430-6b02-4fea-aca4-df79e8293dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.658736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-23f18430-6b02-4fea-aca4-df79e8293dc8 None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:01.659904 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-23f18430-6b02-4fea-aca4-df79e8293dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:01.666767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1413/2789] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 30 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:01.679064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:01.690249 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486978f-a59b-4242-be30-d04851bb5b01 service swift] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:01.695300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680069-8475-440d-b56f-9caf53ec2c92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:01.695809 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680069-8475-440d-b56f-9caf53ec2c92 service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.696086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680069-8475-440d-b56f-9caf53ec2c92 service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.696354 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680069-8475-440d-b56f-9caf53ec2c92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.704364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680069-8475-440d-b56f-9caf53ec2c92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:01.705958 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680069-8475-440d-b56f-9caf53ec2c92 service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:01.714129 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1377/2790] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:03.808820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f18430-6b02-4fea-aca4-df79e8293dc8 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:03.893560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f18430-6b02-4fea-aca4-df79e8293dc8 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:03.898321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:03.898966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:03.899241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:03.899509 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] PATH_INFO: `/v3/users/9b7ec96679cb4af2934d403c6dc0a862` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:03.900668 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7ec96679cb4af2934d403c6dc0a862)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:03.902777 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:03.958754 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7ec96679cb4af2934d403c6dc0a862'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.959426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7ec96679cb4af2934d403c6dc0a862'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.974422 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7ec96679cb4af2934d403c6dc0a862'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.982259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7ec96679cb4af2934d403c6dc0a862'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.983016 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7ec96679cb4af2934d403c6dc0a862'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.996882 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1414/2791] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:03 2022] DELETE /identity/v3/users/9b7ec96679cb4af2934d403c6dc0a862 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:04.002100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.002596 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.002776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.023366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:04.024860 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:04.081665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1378/2792] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:04.091545 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:04.092987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:04.099576 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:04.151145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d00f10-9265-46e4-ac1d-3a8d02032521 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:04.154743 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:04.155373 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.155648 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.155914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.164647 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:04.166085 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:04.176432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1415/2793] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:24:04.354058 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:04.355533 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:04.370085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73638-2d1f-4ad7-9f91-e9944d2bcfb3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:04.375421 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:04.376089 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.377122 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.377854 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] PATH_INFO: `/v3/projects/c65e530c45eb4cc0ba96ad00e74f9c12` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.379019 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65e530c45eb4cc0ba96ad00e74f9c12)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:04.381150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:04.425653 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:04.428579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65e530c45eb4cc0ba96ad00e74f9c12', 'request_id': 'req-19fb5060-2f94-4a7b-92af-94f8c12f1b96'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.436086 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65e530c45eb4cc0ba96ad00e74f9c12', 'request_id': 'req-19fb5060-2f94-4a7b-92af-94f8c12f1b96'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.442323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65e530c45eb4cc0ba96ad00e74f9c12', 'request_id': 'req-19fb5060-2f94-4a7b-92af-94f8c12f1b96'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.453156 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] The token cache is being invalidate because project c65e530c45eb4cc0ba96ad00e74f9c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:04.453437 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.454088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-19fb5060-2f94-4a7b-92af-94f8c12f1b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.455561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1379/2794] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:04 2022] DELETE /identity/v3/projects/c65e530c45eb4cc0ba96ad00e74f9c12 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:08.355151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:08.356615 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:08.370525 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a393d-0f38-42ff-a3f4-1c9c85bb3033 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:08.425661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:08.426200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:08.426474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:08.426742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] PATH_INFO: `/v3/users/b35372419ac246a689156f2c8b68bcb4` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:08.427855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35372419ac246a689156f2c8b68bcb4)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:08.429769 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:08.476055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35372419ac246a689156f2c8b68bcb4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:08.476698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35372419ac246a689156f2c8b68bcb4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:08.488603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35372419ac246a689156f2c8b68bcb4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:08.495657 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35372419ac246a689156f2c8b68bcb4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:08.496298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35372419ac246a689156f2c8b68bcb4'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:08.509104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1416/2795] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:08 2022] DELETE /identity/v3/users/b35372419ac246a689156f2c8b68bcb4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:08.513686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:08.514166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:08.514283 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:08.533324 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:08.534545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:08.591673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1380/2796] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:08.601371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:08.602819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:08.634259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:08.664602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8db1c-fd7f-4366-a61d-97c8914bd8b3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:08.668326 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70405e7-b0a4-43b2-91fa-39e2dc96ea28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:08.668928 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70405e7-b0a4-43b2-91fa-39e2dc96ea28 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:08.669204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70405e7-b0a4-43b2-91fa-39e2dc96ea28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:08.669634 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70405e7-b0a4-43b2-91fa-39e2dc96ea28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:08.682792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70405e7-b0a4-43b2-91fa-39e2dc96ea28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:08.684339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70405e7-b0a4-43b2-91fa-39e2dc96ea28 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:08.695152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1417/2797] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:08.960962 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:08.962472 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:08.977277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd08458-834d-4b30-8c41-9d2db5deae4b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:08.982581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:08.983873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:08.984150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:08.984420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] PATH_INFO: `/v3/projects/6721d9e0f0eb414eb4735d776afc472e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:08.985580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6721d9e0f0eb414eb4735d776afc472e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:08.987501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.039955 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6721d9e0f0eb414eb4735d776afc472e', 'request_id': 'req-92264029-e2f8-4c92-b6ad-2ac94112f902'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:09.047039 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6721d9e0f0eb414eb4735d776afc472e', 'request_id': 'req-92264029-e2f8-4c92-b6ad-2ac94112f902'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:09.052461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6721d9e0f0eb414eb4735d776afc472e', 'request_id': 'req-92264029-e2f8-4c92-b6ad-2ac94112f902'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:09.063901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] The token cache is being invalidate because project 6721d9e0f0eb414eb4735d776afc472e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:09.064183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:09.064805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-92264029-e2f8-4c92-b6ad-2ac94112f902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:09.066322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1381/2798] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:08 2022] DELETE /identity/v3/projects/6721d9e0f0eb414eb4735d776afc472e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:09.072228 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7027db-3fd8-4260-a8f9-032b718b779a None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.072513 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7027db-3fd8-4260-a8f9-032b718b779a None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.072780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7027db-3fd8-4260-a8f9-032b718b779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.091953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-8a7027db-3fd8-4260-a8f9-032b718b779a None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:09.093126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8a7027db-3fd8-4260-a8f9-032b718b779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:09.149457 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1418/2799] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:09.214207 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6526-dbc1-4514-b3d9-a7540074241b None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.214423 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6526-dbc1-4514-b3d9-a7540074241b None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.214674 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba6526-dbc1-4514-b3d9-a7540074241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.235100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-bcba6526-dbc1-4514-b3d9-a7540074241b None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:09.236289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bcba6526-dbc1-4514-b3d9-a7540074241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:09.244368 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1382/2800] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:09.248805 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7027db-3fd8-4260-a8f9-032b718b779a None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.258746 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7027db-3fd8-4260-a8f9-032b718b779a None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.263354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.263945 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.264222 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.264494 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.265132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:09.265437 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.267035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.278596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1419/2801] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:09.283270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6526-dbc1-4514-b3d9-a7540074241b None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.292372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba6526-dbc1-4514-b3d9-a7540074241b None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.297629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.298217 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.298494 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.298761 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.299382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.301247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.327409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1383/2802] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:09 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:09.331419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.341302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776566ba-df7c-4702-ba95-637d6cd52e73 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.394961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.395588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.395800 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.396065 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.396674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.398597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.418918 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1420/2803] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:09 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:09.423772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.433896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2168df-f679-4697-b367-583b2aa11d81 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.438422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.439004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.439277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.439541 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.440165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.441759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.451359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1384/2804] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:09.455099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.465354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227efd6-9bc2-432b-b794-907103f71059 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.471136 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71e561-58bc-4d44-bcf3-d1b82a281423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.471865 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e561-58bc-4d44-bcf3-d1b82a281423 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.472175 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e561-58bc-4d44-bcf3-d1b82a281423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.472448 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e561-58bc-4d44-bcf3-d1b82a281423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.473080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71e561-58bc-4d44-bcf3-d1b82a281423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.474670 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71e561-58bc-4d44-bcf3-d1b82a281423 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.485811 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1421/2805] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:09.489837 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.499629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84195a-b7b8-4705-a960-cbceb8459a77 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.504597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.505221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.505493 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.505792 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] PATH_INFO: `/v3/projects/37c25b2d75d244e4ae4af89be38c5769/users/b6a1ffb6398348baaf6aa2669fcc18b3/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.520807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c25b2d75d244e4ae4af89be38c5769, user_id=b6a1ffb6398348baaf6aa2669fcc18b3, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.523436 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.525558 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:09.537373 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1385/2806] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:09 2022] PUT /identity/v3/projects/37c25b2d75d244e4ae4af89be38c5769/users/b6a1ffb6398348baaf6aa2669fcc18b3/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:24:09.542338 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bce8-957b-47f8-8586-0f2e22d0d7ed None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.542622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bce8-957b-47f8-8586-0f2e22d0d7ed None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.542898 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bce8-957b-47f8-8586-0f2e22d0d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.562205 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0a51bce8-957b-47f8-8586-0f2e22d0d7ed None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:09.563407 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0a51bce8-957b-47f8-8586-0f2e22d0d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:09.597432 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:09.627021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1422/2807] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:09.636622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.638338 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:09.694234 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9f65-67de-4539-a276-d8cfe8d9aa0a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.697875 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.698469 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.698743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.699011 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.708386 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.709845 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.720053 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1386/2808] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:13.794739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2850f-555b-488b-ab92-b08f4250f246 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:13.795198 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2850f-555b-488b-ab92-b08f4250f246 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:13.795294 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2850f-555b-488b-ab92-b08f4250f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:13.825751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-35a2850f-555b-488b-ab92-b08f4250f246 None None] MFA Rules not processed for user `b6a1ffb6398348baaf6aa2669fcc18b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:13.827732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-35a2850f-555b-488b-ab92-b08f4250f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:13.896115 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1423/2809] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:13.900406 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:13.910830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7816b1c-d1a6-40ab-9d8c-1d57e5fef952 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:13.916908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:13.917546 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:13.917832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:13.918155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:13.918726 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:13.922100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:13.957572 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1387/2810] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:13.961533 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2850f-555b-488b-ab92-b08f4250f246 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:13.973645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2850f-555b-488b-ab92-b08f4250f246 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:14.034032 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:14.034605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.034876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.035141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.035758 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:14.037727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:14.060419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1424/2811] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:13 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:14.064963 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:14.075630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0416dcc-3088-47ce-9aed-7dff11cc3053 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:14.080948 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:14.081786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.082218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.082638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.083457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:14.085029 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:14.115811 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1388/2812] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:24:14.119567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:14.130416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5d1de-fe6e-4bdf-af14-8d793e850e2f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:14.135035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:14.135673 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.135951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.136337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] PATH_INFO: `/v3/projects/cb5bfdd1a3ed4d81aefe982759bc047f/users/63888524ccc24a8988830ccaecc58147/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.165302 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5bfdd1a3ed4d81aefe982759bc047f, user_id=63888524ccc24a8988830ccaecc58147, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:14.168081 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:14.188386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1425/2813] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:14 2022] PUT /identity/v3/projects/cb5bfdd1a3ed4d81aefe982759bc047f/users/63888524ccc24a8988830ccaecc58147/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:24:14.198725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:14.216884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab2138-c4af-4de3-babc-07c09748676e admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:14.319426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2d361-33f6-43b2-a427-75719a9ded17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:14.319993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d361-33f6-43b2-a427-75719a9ded17 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.320269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d361-33f6-43b2-a427-75719a9ded17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.320534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d361-33f6-43b2-a427-75719a9ded17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.321184 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2d361-33f6-43b2-a427-75719a9ded17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:14.322891 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2d361-33f6-43b2-a427-75719a9ded17 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:14.335116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1389/2814] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:14.338941 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:14.353379 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b83e57-8803-40e3-a29d-021940b626c0 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:14.359550 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:14.360292 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.360736 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.360868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] PATH_INFO: `/v3/projects/cb5bfdd1a3ed4d81aefe982759bc047f/users/63888524ccc24a8988830ccaecc58147/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.368706 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5bfdd1a3ed4d81aefe982759bc047f, user_id=63888524ccc24a8988830ccaecc58147, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:14.371602 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:14.388694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1426/2815] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:14 2022] PUT /identity/v3/projects/cb5bfdd1a3ed4d81aefe982759bc047f/users/63888524ccc24a8988830ccaecc58147/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:19.546879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105f12-3cf2-4fdf-ac0a-5325d2c4cab7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:19.547393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105f12-3cf2-4fdf-ac0a-5325d2c4cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:19.547501 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea105f12-3cf2-4fdf-ac0a-5325d2c4cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:19.575417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ea105f12-3cf2-4fdf-ac0a-5325d2c4cab7 None None] MFA Rules not processed for user `63888524ccc24a8988830ccaecc58147`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:19.581796 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ea105f12-3cf2-4fdf-ac0a-5325d2c4cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:19.631876 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:19.657748 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1390/2816] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:19.670972 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:19.672900 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:19.697953 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:19.771850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b161b2-7f52-4e9c-a2d1-5c2b9df0a986 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:19.777308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41446-bdc6-4538-8d6e-efcb56f552d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:19.777942 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41446-bdc6-4538-8d6e-efcb56f552d9 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:19.778213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41446-bdc6-4538-8d6e-efcb56f552d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:19.778475 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41446-bdc6-4538-8d6e-efcb56f552d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:19.836301 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41446-bdc6-4538-8d6e-efcb56f552d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:19.837460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41446-bdc6-4538-8d6e-efcb56f552d9 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:19.847139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1427/2817] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:21.085120 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74f0b-b1cf-47b7-a6b7-114c50a1c295 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:21.085670 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74f0b-b1cf-47b7-a6b7-114c50a1c295 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:21.085877 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74f0b-b1cf-47b7-a6b7-114c50a1c295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:21.107899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-e4e74f0b-b1cf-47b7-a6b7-114c50a1c295 None None] MFA Rules not processed for user `b6a1ffb6398348baaf6aa2669fcc18b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:21.109800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-e4e74f0b-b1cf-47b7-a6b7-114c50a1c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:21.117581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1391/2818] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:22.913955 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abad3b-ee57-4a1b-bb9c-41833a829c96 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:22.914571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abad3b-ee57-4a1b-bb9c-41833a829c96 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:22.914571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abad3b-ee57-4a1b-bb9c-41833a829c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:22.947976 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-58abad3b-ee57-4a1b-bb9c-41833a829c96 None None] MFA Rules not processed for user `54604167c97f4d828168ffc330e83ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:22.949531 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-58abad3b-ee57-4a1b-bb9c-41833a829c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:23.053951 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1428/2819] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:31.101560 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=10 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:33.052671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=85 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:45.154965 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74f0b-b1cf-47b7-a6b7-114c50a1c295 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:45.236157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74f0b-b1cf-47b7-a6b7-114c50a1c295 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:45.239754 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:45.240352 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:45.240626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:45.240897 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:45.257719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:45.259128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:45.268327 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1392/2820] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:55.264247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=42 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:31.782499 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:31.783009 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:31.783111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:31.822321 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:31.823534 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:31.888167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1429/2821] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:25:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:31.942660 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:31.944070 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:32.012420 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbf11f-e08a-4b61-9dd8-1ceacd918e41 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:32.017528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ab6f9-8214-4bca-87a1-9ee6974a034f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:32.018139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ab6f9-8214-4bca-87a1-9ee6974a034f service swift] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:32.018418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ab6f9-8214-4bca-87a1-9ee6974a034f service swift] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:32.018691 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ab6f9-8214-4bca-87a1-9ee6974a034f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:32.027316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ab6f9-8214-4bca-87a1-9ee6974a034f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:32.028820 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ab6f9-8214-4bca-87a1-9ee6974a034f service swift] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:32.036783 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1393/2822] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:25:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:34.918825 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:34.920441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:35.042216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09a0c2-c7c0-4117-8117-68fa7e66f23f None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:35.047996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:35.048675 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:35.049018 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:35.049354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:35.051450 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:35.066994 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:35.068663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:35.081380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1430/2823] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:42.033777 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=32 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:45.075015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=73 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:46.709659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69fbf1-8621-4f03-a51a-c89e738ceabe None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:46.710165 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69fbf1-8621-4f03-a51a-c89e738ceabe None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:46.710277 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69fbf1-8621-4f03-a51a-c89e738ceabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:46.729463 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-3d69fbf1-8621-4f03-a51a-c89e738ceabe None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:46.730678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-3d69fbf1-8621-4f03-a51a-c89e738ceabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:46.737705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1394/2824] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 30 04:25:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:46.749922 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:46.761086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7560d-29a2-430a-9f37-db97b184df6d service placement] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:46.765997 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11303898-f150-4106-b389-693c72306786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:46.766554 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11303898-f150-4106-b389-693c72306786 service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:46.766829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11303898-f150-4106-b389-693c72306786 service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:46.767095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11303898-f150-4106-b389-693c72306786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:46.775046 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11303898-f150-4106-b389-693c72306786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:46.776591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11303898-f150-4106-b389-693c72306786 service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:46.784495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1431/2825] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:25:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:25:56.723562 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:56.781250 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:02.297924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.298372 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.298505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.317123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] MFA Rules not processed for user `0d67ec68dae046f0b5ae1b2c30b04a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:02.318361 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:02.325976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1395/2826] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 30 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:02.338073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11303898-f150-4106-b389-693c72306786 service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:02.349681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11303898-f150-4106-b389-693c72306786 service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:02.354713 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16ba94b3c081488a851579dc5883427b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:02.355295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.355571 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.355843 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.363944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:02.365483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:02.373607 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1432/2827] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 30 04:26:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:26:12.311904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:12.370277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=6 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:35.250013 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:35.251401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:35.274896 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10306345-e67a-49cd-afe8-6fab740db28a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:35.278399 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:35.278987 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:35.279265 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:35.279537 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:35.281927 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:35.307759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:35.309168 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:35.329235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1396/2828] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:36.511993 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:36.522337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809432bd-e7a6-4211-8c71-ae78388cf06f service swift] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:36.525866 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:36.526445 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:36.526718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:36.526986 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:36.528695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:36.543389 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:36.544801 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:36.555893 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1433/2829] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:45.139902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:45.153222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03d343-7e86-49a7-9b18-a14a6a377f17 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:45.158947 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:45.159550 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.159828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.160098 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.161843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.174521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:45.176452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:45.201262 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1397/2830] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:45.226349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:45.227849 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.333179 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19613-ff95-4b70-97a3-76764f747346 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:45.338023 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:45.338653 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.338933 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.339208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] PATH_INFO: `/v3/users/54604167c97f4d828168ffc330e83ad2` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.340332 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] RBAC: Authorizing `identity:delete_user(user_id=54604167c97f4d828168ffc330e83ad2)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:45.342289 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:45.388790 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54604167c97f4d828168ffc330e83ad2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.389371 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54604167c97f4d828168ffc330e83ad2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.401783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54604167c97f4d828168ffc330e83ad2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.408645 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54604167c97f4d828168ffc330e83ad2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.409285 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-ef3081e6-62cb-4356-bf78-9a87aea4efac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54604167c97f4d828168ffc330e83ad2'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.421987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1434/2831] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:45 2022] DELETE /identity/v3/users/54604167c97f4d828168ffc330e83ad2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:45.602817 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:45.613581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b394b08-f99c-48e5-9f4b-b3c996cf8f72 service placement] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:45.670022 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:45.670576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.670861 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.671130 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] PATH_INFO: `/v3/projects/6a09fc355e634e9dab0fafed2163a943` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.672813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a09fc355e634e9dab0fafed2163a943)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:45.675293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:45.720112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a09fc355e634e9dab0fafed2163a943', 'request_id': 'req-c97aa577-2694-4bda-a5d0-72b71086a10c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.726822 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a09fc355e634e9dab0fafed2163a943', 'request_id': 'req-c97aa577-2694-4bda-a5d0-72b71086a10c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.732201 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a09fc355e634e9dab0fafed2163a943', 'request_id': 'req-c97aa577-2694-4bda-a5d0-72b71086a10c'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.743446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] The token cache is being invalidate because project 6a09fc355e634e9dab0fafed2163a943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:45.743728 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.744346 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c97aa577-2694-4bda-a5d0-72b71086a10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:45.745883 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1398/2832] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:45 2022] DELETE /identity/v3/projects/6a09fc355e634e9dab0fafed2163a943 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:45.751455 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8978-27af-41f1-b2c7-ad2c18b63536 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.751738 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8978-27af-41f1-b2c7-ad2c18b63536 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.752008 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8978-27af-41f1-b2c7-ad2c18b63536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.806729 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:45.809617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-875e8978-27af-41f1-b2c7-ad2c18b63536 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:45.811461 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-875e8978-27af-41f1-b2c7-ad2c18b63536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.879352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1435/2833] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:45.887281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f947e-ef8b-4d62-9754-6e9216074a64 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.887559 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f947e-ef8b-4d62-9754-6e9216074a64 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.887826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f947e-ef8b-4d62-9754-6e9216074a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.907366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-5a6f947e-ef8b-4d62-9754-6e9216074a64 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:45.908569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5a6f947e-ef8b-4d62-9754-6e9216074a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.916511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1399/2834] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:45.920755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8978-27af-41f1-b2c7-ad2c18b63536 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:45.930760 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8978-27af-41f1-b2c7-ad2c18b63536 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:45.935501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:45.936091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.936364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.936636 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.937273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:45.937600 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:45.939909 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:45.952092 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1436/2835] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:45.956457 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f947e-ef8b-4d62-9754-6e9216074a64 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:45.965743 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f947e-ef8b-4d62-9754-6e9216074a64 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:45.971181 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:45.971773 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.972065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.972360 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.972990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:45.974977 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:46.000974 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:46.020391 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1400/2836] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:45 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:26:46.021273 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:46.032116 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca772bb0-397e-4ce6-90db-4c6de3e3d39b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:46.089692 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:46.090298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:46.090608 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:46.090840 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:46.091472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:46.093834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:46.115458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1437/2837] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:46 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:26:46.119665 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:46.129867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24039911-8547-4789-aa70-cbb84a79e40c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:46.134509 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:46.135093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:46.135366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:46.135631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:46.136291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:46.137901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:46.147645 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1401/2838] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:26:46.151544 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:46.161741 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa6d4-cc7f-4f32-b5e7-936ea7782494 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:46.166308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ad5d-fddc-497c-9ed4-1a288ad2daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:46.166879 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ad5d-fddc-497c-9ed4-1a288ad2daf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:46.167152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ad5d-fddc-497c-9ed4-1a288ad2daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:46.167416 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ad5d-fddc-497c-9ed4-1a288ad2daf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:46.168038 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478ad5d-fddc-497c-9ed4-1a288ad2daf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:46.169622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478ad5d-fddc-497c-9ed4-1a288ad2daf4 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:46.185364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1438/2839] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:46.189814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:46.200081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90988850-2e2a-4f9f-9b87-e441f79493b5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:46.204590 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:46.205222 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:46.205496 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:46.205790 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] PATH_INFO: `/v3/projects/765a8c6eb087499a85b698c087215660/users/8afbaf37967249889411a78e5fbbb60b/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:46.220828 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=765a8c6eb087499a85b698c087215660, user_id=8afbaf37967249889411a78e5fbbb60b, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:46.223450 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:46.236264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1402/2840] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:46 2022] PUT /identity/v3/projects/765a8c6eb087499a85b698c087215660/users/8afbaf37967249889411a78e5fbbb60b/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:26:46.246661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d4ea-c447-40e2-9bf6-1caab6ab912b None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:46.247080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d4ea-c447-40e2-9bf6-1caab6ab912b None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:46.247268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d4ea-c447-40e2-9bf6-1caab6ab912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:46.277054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-d322d4ea-c447-40e2-9bf6-1caab6ab912b None None] MFA Rules not processed for user `8afbaf37967249889411a78e5fbbb60b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:46.278365 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-d322d4ea-c447-40e2-9bf6-1caab6ab912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:46.345035 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1439/2841] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:46.356062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:46.357816 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:46.438784 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ee71d-a7b0-4c35-bc3c-3993ecfea89f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:46.442389 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa14de-f49d-4bfa-bb04-14be716e9815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:46.442988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa14de-f49d-4bfa-bb04-14be716e9815 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:46.443268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa14de-f49d-4bfa-bb04-14be716e9815 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:46.443540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa14de-f49d-4bfa-bb04-14be716e9815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:46.451684 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa14de-f49d-4bfa-bb04-14be716e9815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:46.453131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa14de-f49d-4bfa-bb04-14be716e9815 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:46.462732 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1403/2842] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:54.978189 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322d4ea-c447-40e2-9bf6-1caab6ab912b None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:54.982405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:55.041577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322d4ea-c447-40e2-9bf6-1caab6ab912b None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:55.046022 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:55.046663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.046931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.047194 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] PATH_INFO: `/v3/users/8afbaf37967249889411a78e5fbbb60b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.048307 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8afbaf37967249889411a78e5fbbb60b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:55.050249 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:55.096992 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8afbaf37967249889411a78e5fbbb60b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.097684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8afbaf37967249889411a78e5fbbb60b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.109295 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8afbaf37967249889411a78e5fbbb60b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.116134 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8afbaf37967249889411a78e5fbbb60b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.116770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8afbaf37967249889411a78e5fbbb60b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.129885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1440/2843] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:54 2022] DELETE /identity/v3/users/8afbaf37967249889411a78e5fbbb60b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:55.134356 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.134873 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.135004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.154622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:55.155821 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:55.217266 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1404/2844] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:55.227167 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:55.228903 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:55.287783 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5c30c-5412-46b0-86c8-1773c9ac807c admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:55.291343 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630975f8-8e7c-4a43-8df2-00cda88040f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:55.291935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630975f8-8e7c-4a43-8df2-00cda88040f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.292210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630975f8-8e7c-4a43-8df2-00cda88040f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.292478 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630975f8-8e7c-4a43-8df2-00cda88040f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.301707 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630975f8-8e7c-4a43-8df2-00cda88040f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:55.303104 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630975f8-8e7c-4a43-8df2-00cda88040f3 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:55.312260 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1441/2845] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:55.597384 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:55.598839 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:55.610992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b90ce-c5c5-4e1a-95b1-efc699860183 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:55.618116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:55.618848 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.619212 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.619554 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] PATH_INFO: `/v3/projects/765a8c6eb087499a85b698c087215660` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.620975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765a8c6eb087499a85b698c087215660)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:55.623030 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:55.667968 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:55.677741 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765a8c6eb087499a85b698c087215660', 'request_id': 'req-e2ea3361-5ecb-4201-8fc3-1808528ca473'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.685337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765a8c6eb087499a85b698c087215660', 'request_id': 'req-e2ea3361-5ecb-4201-8fc3-1808528ca473'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.691656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765a8c6eb087499a85b698c087215660', 'request_id': 'req-e2ea3361-5ecb-4201-8fc3-1808528ca473'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.703128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] The token cache is being invalidate because project 765a8c6eb087499a85b698c087215660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:55.703409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.704048 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-e2ea3361-5ecb-4201-8fc3-1808528ca473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:55.706189 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1405/2846] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:55 2022] DELETE /identity/v3/projects/765a8c6eb087499a85b698c087215660 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:55.711078 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1773e-ec3e-45be-a38b-70cc1c4f6f1c None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.711356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1773e-ec3e-45be-a38b-70cc1c4f6f1c None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.711622 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1773e-ec3e-45be-a38b-70cc1c4f6f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.730975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2be1773e-ec3e-45be-a38b-70cc1c4f6f1c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:55.732171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2be1773e-ec3e-45be-a38b-70cc1c4f6f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:55.750936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:55.801357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1442/2847] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:55.809081 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fbe2-2159-4da3-b49d-f604f9d4a8d3 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.809364 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fbe2-2159-4da3-b49d-f604f9d4a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.809692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fbe2-2159-4da3-b49d-f604f9d4a8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.830461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-fc93fbe2-2159-4da3-b49d-f604f9d4a8d3 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:55.831686 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-fc93fbe2-2159-4da3-b49d-f604f9d4a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:55.839526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1406/2848] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:55.843936 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1773e-ec3e-45be-a38b-70cc1c4f6f1c None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:55.853419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1773e-ec3e-45be-a38b-70cc1c4f6f1c None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:55.857996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:55.858580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.858858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.859131 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.859766 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:55.860066 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:55.861698 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:55.873055 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1443/2849] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:55.877768 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fbe2-2159-4da3-b49d-f604f9d4a8d3 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:55.886807 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fbe2-2159-4da3-b49d-f604f9d4a8d3 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:55.891393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:55.892582 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.892901 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.893131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.893798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:55.895656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:55.922513 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1407/2850] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:55 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:55.926605 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:55.936679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f30a-4ef1-4ed2-a322-3e281169d877 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:55.993578 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:55.994235 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:55.994431 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:55.994702 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:55.995325 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:55.997200 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.019462 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1444/2851] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:55 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:56.023677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.033926 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a92e-32d0-4a3d-bc14-a23fcd8f2562 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.038542 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.039132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.039411 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.039683 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.040316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.041938 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.052232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1408/2852] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:56.055983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.066356 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8706c1-931e-489a-9e50-73b5976fb20b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.070872 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4748-be41-4473-8b56-6ee46b0ba15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.071440 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4748-be41-4473-8b56-6ee46b0ba15c admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.071714 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4748-be41-4473-8b56-6ee46b0ba15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.071979 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4748-be41-4473-8b56-6ee46b0ba15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.072599 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4748-be41-4473-8b56-6ee46b0ba15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.074181 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4748-be41-4473-8b56-6ee46b0ba15c admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.084441 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1445/2853] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:56.088451 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.098551 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d392-eaeb-4b64-bad8-c5525e578495 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.103344 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.103979 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.104259 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.104522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] PATH_INFO: `/v3/projects/9a65b6cc0a974d9686f917562731b568/users/326859cf27024845ac48e0c415fe0cdd/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.120439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a65b6cc0a974d9686f917562731b568, user_id=326859cf27024845ac48e0c415fe0cdd, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.123056 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.136337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1409/2854] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:56 2022] PUT /identity/v3/projects/9a65b6cc0a974d9686f917562731b568/users/326859cf27024845ac48e0c415fe0cdd/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:56.146515 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754bfa-4dd0-4913-8027-9189d73527f6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.146796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754bfa-4dd0-4913-8027-9189d73527f6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.147063 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754bfa-4dd0-4913-8027-9189d73527f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.174258 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-2b754bfa-4dd0-4913-8027-9189d73527f6 None None] MFA Rules not processed for user `326859cf27024845ac48e0c415fe0cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:56.175469 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2b754bfa-4dd0-4913-8027-9189d73527f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:56.240678 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1446/2855] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:56.245144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.310881 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717686f8-5ddd-4489-a34c-7a430e2b6e4b admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.315981 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.316568 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.316867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.317128 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.317774 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.319639 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.344595 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1410/2856] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:56 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:56.348735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754bfa-4dd0-4913-8027-9189d73527f6 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.359391 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754bfa-4dd0-4913-8027-9189d73527f6 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.377543 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:56.417998 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.418594 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.418871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.419145 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.419770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.421681 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.443360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1447/2857] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:56 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:56.447401 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.460505 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23dd3-8e18-470f-afd7-3cd529f54094 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.465254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.465985 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.466269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.466576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.467251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.469144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.480322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1411/2858] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:56.484603 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.495124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ad730-a03c-4e1e-a10f-4a7ebe6e6d4d admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.499715 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.500339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.500610 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.500876 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] PATH_INFO: `/v3/projects/93969ebc9eaf4ead82b4ff6c10d5ba8e/users/cc5e41ee0f8548b5b8a449635749a6e0/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.515026 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93969ebc9eaf4ead82b4ff6c10d5ba8e, user_id=cc5e41ee0f8548b5b8a449635749a6e0, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.517693 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.529868 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1448/2859] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:56 2022] PUT /identity/v3/projects/93969ebc9eaf4ead82b4ff6c10d5ba8e/users/cc5e41ee0f8548b5b8a449635749a6e0/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:56.534310 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.546172 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a849a-8b80-4590-984a-7294c2b0adfe admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.584199 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:56.611575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcf04e-f822-4c8c-b064-5b4e63b3a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.612176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf04e-f822-4c8c-b064-5b4e63b3a188 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.612448 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf04e-f822-4c8c-b064-5b4e63b3a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.612713 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcf04e-f822-4c8c-b064-5b4e63b3a188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.613343 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcf04e-f822-4c8c-b064-5b4e63b3a188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.614983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcf04e-f822-4c8c-b064-5b4e63b3a188 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.624468 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1412/2860] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:56.628697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.639275 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1598c4-6411-44d6-a304-3e047b136e05 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.643925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.644557 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.644819 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.645091 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] PATH_INFO: `/v3/projects/93969ebc9eaf4ead82b4ff6c10d5ba8e/users/cc5e41ee0f8548b5b8a449635749a6e0/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.647054 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93969ebc9eaf4ead82b4ff6c10d5ba8e, user_id=cc5e41ee0f8548b5b8a449635749a6e0, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.649697 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.660352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1449/2861] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:56 2022] PUT /identity/v3/projects/93969ebc9eaf4ead82b4ff6c10d5ba8e/users/cc5e41ee0f8548b5b8a449635749a6e0/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:26:56.674416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24016f8f-96bc-45db-80cf-f2325b06daea None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.674694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24016f8f-96bc-45db-80cf-f2325b06daea None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.674992 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24016f8f-96bc-45db-80cf-f2325b06daea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.702704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-24016f8f-96bc-45db-80cf-f2325b06daea None None] MFA Rules not processed for user `cc5e41ee0f8548b5b8a449635749a6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:56.703894 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-24016f8f-96bc-45db-80cf-f2325b06daea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:56.771641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1413/2862] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:56 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:56.782310 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:56.784587 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:56.842394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b266b7-20fd-465a-9218-1d2afc6f16a3 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:56.847256 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72bb2d-baa8-42c3-abda-ea662490c5e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:56.847861 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72bb2d-baa8-42c3-abda-ea662490c5e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:56.848139 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72bb2d-baa8-42c3-abda-ea662490c5e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:56.848408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72bb2d-baa8-42c3-abda-ea662490c5e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:56.857623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72bb2d-baa8-42c3-abda-ea662490c5e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:56.859105 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72bb2d-baa8-42c3-abda-ea662490c5e3 service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:56.868663 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1450/2863] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:56 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:57.034944 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24016f8f-96bc-45db-80cf-f2325b06daea None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:57.096095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24016f8f-96bc-45db-80cf-f2325b06daea None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:57.100483 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:57.101092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:57.101383 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:57.101663 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] PATH_INFO: `/v3/users/326859cf27024845ac48e0c415fe0cdd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:57.102763 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=326859cf27024845ac48e0c415fe0cdd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:57.104638 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:57.151424 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326859cf27024845ac48e0c415fe0cdd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.152103 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326859cf27024845ac48e0c415fe0cdd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.159502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326859cf27024845ac48e0c415fe0cdd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.164119 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.168150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326859cf27024845ac48e0c415fe0cdd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.169227 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326859cf27024845ac48e0c415fe0cdd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.188832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1414/2864] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:57 2022] DELETE /identity/v3/users/326859cf27024845ac48e0c415fe0cdd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:57.195883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:57.196585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:57.196585 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:57.216378 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:57.217650 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:57.278962 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1451/2865] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:57.286365 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:57.287781 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:57.349975 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2409a1-62a9-4c41-bc84-6e4e120b9939 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:57.353745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:57.354335 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:57.354612 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:57.354879 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:57.364766 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:57.366539 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:57.376480 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1415/2866] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:57.531990 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:57.534005 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:57.548282 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33394534-f02f-4d39-9540-77d7e87e6987 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:57.552597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:57.553309 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:57.553662 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:57.553995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:57.555850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:57.569339 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:57.570890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:57.580490 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1452/2867] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:57.748580 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:57.750208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:57.762826 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03513b8-1456-43f3-90c1-b5d0751507f3 service neutron] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:57.769369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:57.770111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:57.770409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:57.771402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] PATH_INFO: `/v3/projects/9a65b6cc0a974d9686f917562731b568` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:57.772859 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a65b6cc0a974d9686f917562731b568)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:57.774832 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:57.826223 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a65b6cc0a974d9686f917562731b568', 'request_id': 'req-bf04503f-cdab-4050-a5fe-9b917cf659dd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.835264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a65b6cc0a974d9686f917562731b568', 'request_id': 'req-bf04503f-cdab-4050-a5fe-9b917cf659dd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.841641 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a65b6cc0a974d9686f917562731b568', 'request_id': 'req-bf04503f-cdab-4050-a5fe-9b917cf659dd'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.854659 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] The token cache is being invalidate because project 9a65b6cc0a974d9686f917562731b568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:57.855232 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.856068 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.861591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1416/2868] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:57 2022] DELETE /identity/v3/projects/9a65b6cc0a974d9686f917562731b568 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:57.863419 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:57.869451 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.875837 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede5552-ebbc-4683-aed7-69ac0e7c8b73 service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:57.936480 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:57.937064 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:57.937337 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:57.937646 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] PATH_INFO: `/v3/users/cc5e41ee0f8548b5b8a449635749a6e0` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:57.939300 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5e41ee0f8548b5b8a449635749a6e0)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:57.941241 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:57.996279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5e41ee0f8548b5b8a449635749a6e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:57.997029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5e41ee0f8548b5b8a449635749a6e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.009934 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5e41ee0f8548b5b8a449635749a6e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.017835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5e41ee0f8548b5b8a449635749a6e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.018567 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-51b60c81-f487-4412-9d23-7076b171b177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5e41ee0f8548b5b8a449635749a6e0'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.034617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1453/2869] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:57 2022] DELETE /identity/v3/users/cc5e41ee0f8548b5b8a449635749a6e0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:58.344626 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:58.346144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:58.360426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04503f-cdab-4050-a5fe-9b917cf659dd admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:58.419291 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:58.419843 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.420123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.420397 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] PATH_INFO: `/v3/projects/93969ebc9eaf4ead82b4ff6c10d5ba8e` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.421530 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93969ebc9eaf4ead82b4ff6c10d5ba8e)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:58.423932 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:58.430158 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:58.471422 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93969ebc9eaf4ead82b4ff6c10d5ba8e', 'request_id': 'req-5eea8834-401d-48e6-956f-3e9ec6237b66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.478731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93969ebc9eaf4ead82b4ff6c10d5ba8e', 'request_id': 'req-5eea8834-401d-48e6-956f-3e9ec6237b66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.484150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93969ebc9eaf4ead82b4ff6c10d5ba8e', 'request_id': 'req-5eea8834-401d-48e6-956f-3e9ec6237b66'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.495591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] The token cache is being invalidate because project 93969ebc9eaf4ead82b4ff6c10d5ba8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:58.495878 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.496511 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5eea8834-401d-48e6-956f-3e9ec6237b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:58.498018 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1417/2870] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:58 2022] DELETE /identity/v3/projects/93969ebc9eaf4ead82b4ff6c10d5ba8e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:58.505281 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e00f-ca7c-4cb9-97d8-145fbde54932 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.505813 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e00f-ca7c-4cb9-97d8-145fbde54932 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.505910 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e00f-ca7c-4cb9-97d8-145fbde54932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.526271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-0b13e00f-ca7c-4cb9-97d8-145fbde54932 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:58.527472 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-0b13e00f-ca7c-4cb9-97d8-145fbde54932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:58.585482 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1454/2871] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:58.593208 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331ceb-a07e-4704-84c7-653fa3c6957d None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.593786 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331ceb-a07e-4704-84c7-653fa3c6957d None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.594065 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e331ceb-a07e-4704-84c7-653fa3c6957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.615183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-8e331ceb-a07e-4704-84c7-653fa3c6957d None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:58.616417 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-8e331ceb-a07e-4704-84c7-653fa3c6957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:58.624337 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1418/2872] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:58.629029 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e00f-ca7c-4cb9-97d8-145fbde54932 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:58.641132 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e00f-ca7c-4cb9-97d8-145fbde54932 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:58.646041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:58.646659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.646938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.647210 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.647852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:58.648151 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:58.649732 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:58.661740 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1455/2873] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:58.666268 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331ceb-a07e-4704-84c7-653fa3c6957d None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:58.675983 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e331ceb-a07e-4704-84c7-653fa3c6957d None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:58.680750 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:58.681341 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.681658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.681928 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.682561 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:58.684502 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:58.710906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1419/2874] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:58 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:58.714996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:58.727894 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66ec5a-659f-4af3-a02b-fd6979c9b6e5 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:58.732589 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:58.784357 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:58.784961 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.785238 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.785537 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.786159 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:58.788051 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:58.809817 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1456/2875] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:58 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:58.814024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:58.824398 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509e532-ce24-4fb8-9a51-fdc079f40648 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:58.829113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:58.829759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.830038 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.830308 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.830945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:58.832519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:58.843092 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1420/2876] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:58.847931 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:58.857680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d95774-1e2e-4138-a06b-ec6e51ae1332 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:58.862827 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601a27f-b99a-4ffe-887b-2218b6982233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:58.863405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a27f-b99a-4ffe-887b-2218b6982233 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.863680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a27f-b99a-4ffe-887b-2218b6982233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.863948 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a27f-b99a-4ffe-887b-2218b6982233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.864574 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601a27f-b99a-4ffe-887b-2218b6982233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:58.866171 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601a27f-b99a-4ffe-887b-2218b6982233 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:58.876529 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1457/2877] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:58.880571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:58.890270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568b1a2-ca43-4db3-841f-a19ad1cda72a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:58.894899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:58.895523 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.895795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.896061 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] PATH_INFO: `/v3/projects/894fe591c78f4e17aa8f73c019e16f57/users/77dc15893fa64a439532b685dcda0a1b/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.910581 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894fe591c78f4e17aa8f73c019e16f57, user_id=77dc15893fa64a439532b685dcda0a1b, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:58.913173 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:58.926853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1421/2878] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:58 2022] PUT /identity/v3/projects/894fe591c78f4e17aa8f73c019e16f57/users/77dc15893fa64a439532b685dcda0a1b/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:58.937100 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144824d5-f101-4dec-9203-c43703579081 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:58.937385 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144824d5-f101-4dec-9203-c43703579081 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:58.937687 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144824d5-f101-4dec-9203-c43703579081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:58.967908 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-144824d5-f101-4dec-9203-c43703579081 None None] MFA Rules not processed for user `77dc15893fa64a439532b685dcda0a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:58.970520 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-144824d5-f101-4dec-9203-c43703579081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:59.035058 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1458/2879] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:59.068524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:59.070295 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:59.127304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9968d1-7db4-4640-9c7b-9dc2416b8af2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:59.131074 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ed895-30ca-4067-8e87-a0ca81eb8e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:59.131672 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed895-30ca-4067-8e87-a0ca81eb8e05 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:59.131949 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed895-30ca-4067-8e87-a0ca81eb8e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:59.132220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed895-30ca-4067-8e87-a0ca81eb8e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:59.140531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ed895-30ca-4067-8e87-a0ca81eb8e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:59.142476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ed895-30ca-4067-8e87-a0ca81eb8e05 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:59.151239 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1422/2880] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:59.166573 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144824d5-f101-4dec-9203-c43703579081 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:59.231871 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144824d5-f101-4dec-9203-c43703579081 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:59.236497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:59.237126 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:59.237401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:59.237718 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] PATH_INFO: `/v3/users/77dc15893fa64a439532b685dcda0a1b` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:59.238854 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77dc15893fa64a439532b685dcda0a1b)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:59.240753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:59.261842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:59.289755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77dc15893fa64a439532b685dcda0a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.290438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77dc15893fa64a439532b685dcda0a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.302598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77dc15893fa64a439532b685dcda0a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.309577 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77dc15893fa64a439532b685dcda0a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.310264 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77dc15893fa64a439532b685dcda0a1b'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.323842 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1459/2881] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:59 2022] DELETE /identity/v3/users/77dc15893fa64a439532b685dcda0a1b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:26:59.328194 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:59.328565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:59.328908 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:59.349330 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:59.350579 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:59.381910 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:59.418735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1423/2882] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:59.428546 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:59.429966 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:59.502968 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f9ef7-e541-4549-bbd1-953455f1385f admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:59.508940 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec769152-fb83-4221-8466-323dfc10c34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:59.509566 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769152-fb83-4221-8466-323dfc10c34a service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:59.509844 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769152-fb83-4221-8466-323dfc10c34a service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:59.510114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769152-fb83-4221-8466-323dfc10c34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:59.519804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec769152-fb83-4221-8466-323dfc10c34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:59.521229 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec769152-fb83-4221-8466-323dfc10c34a service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:59.530500 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1460/2883] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:59.828095 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:59.830813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:59.847589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c35fc-8252-4087-bbae-830321ae8f11 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:59.852527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:59.853667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:59.853667 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:59.854545 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] PATH_INFO: `/v3/projects/894fe591c78f4e17aa8f73c019e16f57` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:59.855993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] RBAC: Authorizing `identity:delete_project(project_id=894fe591c78f4e17aa8f73c019e16f57)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:59.858629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:59.912857 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894fe591c78f4e17aa8f73c019e16f57', 'request_id': 'req-b0fbffad-fa1c-4c38-98ec-cc572f02297b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.921745 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894fe591c78f4e17aa8f73c019e16f57', 'request_id': 'req-b0fbffad-fa1c-4c38-98ec-cc572f02297b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.928091 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894fe591c78f4e17aa8f73c019e16f57', 'request_id': 'req-b0fbffad-fa1c-4c38-98ec-cc572f02297b'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.946275 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] The token cache is being invalidate because project 894fe591c78f4e17aa8f73c019e16f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:59.946630 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.947449 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-b0fbffad-fa1c-4c38-98ec-cc572f02297b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:59.949218 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1424/2884] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:59 2022] DELETE /identity/v3/projects/894fe591c78f4e17aa8f73c019e16f57 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:59.955460 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d464ba9-f34b-4e1e-9c44-cf702edb9e87 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:59.955770 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d464ba9-f34b-4e1e-9c44-cf702edb9e87 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:59.956042 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d464ba9-f34b-4e1e-9c44-cf702edb9e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:59.978076 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-7d464ba9-f34b-4e1e-9c44-cf702edb9e87 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:59.979330 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7d464ba9-f34b-4e1e-9c44-cf702edb9e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:00.048047 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1461/2885] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:00.058704 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc6e65-af65-4eb6-83ea-4d2904c969e7 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.059093 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc6e65-af65-4eb6-83ea-4d2904c969e7 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.059280 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc6e65-af65-4eb6-83ea-4d2904c969e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.081731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-6dfc6e65-af65-4eb6-83ea-4d2904c969e7 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:00.082950 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-6dfc6e65-af65-4eb6-83ea-4d2904c969e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:00.094455 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1425/2886] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:00.100212 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d464ba9-f34b-4e1e-9c44-cf702edb9e87 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.110380 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d464ba9-f34b-4e1e-9c44-cf702edb9e87 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.115073 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.115669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.115944 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.116214 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.116852 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:27:00.117152 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.118751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.130410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1462/2887] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:27:00.134824 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc6e65-af65-4eb6-83ea-4d2904c969e7 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.144634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc6e65-af65-4eb6-83ea-4d2904c969e7 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.149297 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.149934 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.150214 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.150485 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.151108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.152997 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.180920 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1426/2888] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:00.185141 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.195971 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaedde9-19e2-40cd-8e45-bd3fda5a2157 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.222259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:00.266596 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.267848 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.268123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.268393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.269061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.271862 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.307101 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1463/2889] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:00.308300 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.321906 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925307-35de-410d-bbf6-d842030b7d10 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.327169 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.328236 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.328804 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.329370 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.330998 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.332629 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.344264 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1427/2890] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:27:00.348359 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.358728 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814852eb-271f-41a5-a48a-5ec35fd980a2 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.363580 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec74d-a823-470a-8aac-a6cd2511f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.364178 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec74d-a823-470a-8aac-a6cd2511f19d admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.364458 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec74d-a823-470a-8aac-a6cd2511f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.364724 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec74d-a823-470a-8aac-a6cd2511f19d admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.365358 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec74d-a823-470a-8aac-a6cd2511f19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.366969 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec74d-a823-470a-8aac-a6cd2511f19d admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.380464 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1464/2891] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:00.384635 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.395154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd51e1-d379-458f-a3f1-9b4a77c0c2ee admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.399719 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.400350 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.400622 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.400887 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] PATH_INFO: `/v3/projects/e4bd2a64569648c0ad6932f8dff9c8ea/users/9f06d9bafacc47029579682933a2f073/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.415956 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bd2a64569648c0ad6932f8dff9c8ea, user_id=9f06d9bafacc47029579682933a2f073, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.418565 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.435681 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1428/2892] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:00 2022] PUT /identity/v3/projects/e4bd2a64569648c0ad6932f8dff9c8ea/users/9f06d9bafacc47029579682933a2f073/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:00.499679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.499964 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.500234 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.529946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] MFA Rules not processed for user `9f06d9bafacc47029579682933a2f073`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:00.531163 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:00.597785 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1465/2893] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:00.602254 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.637684 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.639263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:00.665414 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:00.680085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcc1bd-f0b6-42b3-abd1-1bd6ec727aa6 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.685874 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.686830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.687111 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.687393 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.688034 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.690528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.701674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6056980-0935-444a-9b0d-9fc05cc2c605 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.705425 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.706123 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.706399 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.706674 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.708850 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:00.719522 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1429/2894] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:00.719751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.721120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.723467 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.729820 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1466/2895] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:27:00.786827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e8deb-0b09-4f86-9952-972ee4ab6b2d admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.792589 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.793229 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.793524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.793805 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.794471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.796899 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.823112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1430/2896] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:27:00.830613 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.842298 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57393fe-6c10-4d7e-8bfe-109aa307d36c service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.847716 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e303c2-3b6c-44a4-92aa-968a04229025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.848312 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e303c2-3b6c-44a4-92aa-968a04229025 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.848617 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e303c2-3b6c-44a4-92aa-968a04229025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.848890 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e303c2-3b6c-44a4-92aa-968a04229025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.849568 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e303c2-3b6c-44a4-92aa-968a04229025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.851207 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e303c2-3b6c-44a4-92aa-968a04229025 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.863165 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1467/2897] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:00.867235 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.871006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bead14c-77e7-4a97-b4e3-189ed89b6b9d None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.871393 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bead14c-77e7-4a97-b4e3-189ed89b6b9d None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.871791 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bead14c-77e7-4a97-b4e3-189ed89b6b9d None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.873661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1468/2898] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:00.878858 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963cbe-3859-4f46-aed3-ca14fa806be8 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.880376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87924fe5-be33-47ee-b48e-475ce129de40 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.880759 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87924fe5-be33-47ee-b48e-475ce129de40 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.881128 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87924fe5-be33-47ee-b48e-475ce129de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.894935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.895553 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.895831 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.896117 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.896760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.898402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.911083 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1431/2899] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:00.916699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:00.923859 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-87924fe5-be33-47ee-b48e-475ce129de40 None None] MFA Rules not processed for user `f520107f73aa48f791461922a3d6ec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:00.925067 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-87924fe5-be33-47ee-b48e-475ce129de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:00.928281 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fffe8-1023-40e6-9753-5d8eee610eb9 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:00.934874 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:00.937198 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7e15b-fea3-4319-b349-b715efab87a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:00.938069 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7e15b-fea3-4319-b349-b715efab87a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.938349 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7e15b-fea3-4319-b349-b715efab87a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.938621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7e15b-fea3-4319-b349-b715efab87a9 admin admin] PATH_INFO: `/v3/projects/759b1ffb9eeb48078cdc410e2c23e471/users/3c3150f1eff8416cb556a7f844aa790c/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:00.955710 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7e15b-fea3-4319-b349-b715efab87a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759b1ffb9eeb48078cdc410e2c23e471, user_id=3c3150f1eff8416cb556a7f844aa790c, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:00.958571 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7e15b-fea3-4319-b349-b715efab87a9 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:00.977409 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1432/2900] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:00 2022] PUT /identity/v3/projects/759b1ffb9eeb48078cdc410e2c23e471/users/3c3150f1eff8416cb556a7f844aa790c/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:00.987853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceff17-7b3e-4d42-9fc0-35a726068fec None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:00.988167 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceff17-7b3e-4d42-9fc0-35a726068fec None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:00.988476 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceff17-7b3e-4d42-9fc0-35a726068fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.003751 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1469/2901] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:01.019117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87924fe5-be33-47ee-b48e-475ce129de40 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.022945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-86ceff17-7b3e-4d42-9fc0-35a726068fec None None] MFA Rules not processed for user `3c3150f1eff8416cb556a7f844aa790c`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:01.024445 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-86ceff17-7b3e-4d42-9fc0-35a726068fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.028253 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87924fe5-be33-47ee-b48e-475ce129de40 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.079444 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c5633-23f2-4b85-af75-d8772c7ffac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.080598 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5633-23f2-4b85-af75-d8772c7ffac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.080938 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5633-23f2-4b85-af75-d8772c7ffac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.081209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5633-23f2-4b85-af75-d8772c7ffac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.088442 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c5633-23f2-4b85-af75-d8772c7ffac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.089884 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c5633-23f2-4b85-af75-d8772c7ffac0 service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.092180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1433/2902] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:01.096994 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ceff17-7b3e-4d42-9fc0-35a726068fec None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.097889 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1470/2903] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:01.122812 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:01.164785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ceff17-7b3e-4d42-9fc0-35a726068fec None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.169382 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.170015 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.170290 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.170621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.171183 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.173077 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.197182 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877bfbb-0b5c-491b-bdfa-111bce940dc0 None None] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.197824 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877bfbb-0b5c-491b-bdfa-111bce940dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.198625 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877bfbb-0b5c-491b-bdfa-111bce940dc0 None None] PATH_INFO: `/` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.201148 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1471/2904] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 30 04:27:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:27:01.207277 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.207560 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.207677 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1434/2905] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:27:01 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:27:01.207828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.211544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.245492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] MFA Rules not processed for user `c8b82c351b9340ee88bbb4a9b490847f`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:01.246915 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.274202 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c17d09-1c04-4e7e-b052-fa19c24b6cd5 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.279138 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.279740 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.280016 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.280312 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.280990 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.283108 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.305649 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1435/2906] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:27:01 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:27:01.309759 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.320477 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dbec4-815f-4210-8e89-16fffed61e02 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.320926 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1472/2907] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 30 04:27:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:01.325289 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.325943 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.326220 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.326491 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.327137 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.328866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.332270 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.333912 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.341163 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1436/2908] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:27:01.345633 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.355827 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389135b-3995-44fb-8467-7edb2018e394 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.361326 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.362023 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.362304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.362575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] PATH_INFO: `/v3/projects/0dcdc73c9e214c8bb1693aca1eabbf75/users/624824dec06f4e239921437e407361ea/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.380251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcdc73c9e214c8bb1693aca1eabbf75, user_id=624824dec06f4e239921437e407361ea, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.382842 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.385883 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:01.397810 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1437/2909] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:01 2022] PUT /identity/v3/projects/0dcdc73c9e214c8bb1693aca1eabbf75/users/624824dec06f4e239921437e407361ea/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:27:01.398335 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7c9f-d16b-493d-bc64-5fc2e9b1add6 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.401671 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.447591 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.448197 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.448489 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.448755 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.462534 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc677ec9-cbda-4691-9b20-0192fc7dc81f admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.467144 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.467806 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.468090 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.468363 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.469427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.471082 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.473154 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:01.484055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1438/2910] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:27:01.488519 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.498166 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e1ab4-02b8-48b9-954b-a3a56a99414c admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.503413 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca3efe-72a8-4399-bf93-5d89e283e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.504040 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3efe-72a8-4399-bf93-5d89e283e8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.504317 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3efe-72a8-4399-bf93-5d89e283e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.504592 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca3efe-72a8-4399-bf93-5d89e283e8b1 admin admin] PATH_INFO: `/v3/projects/0dcdc73c9e214c8bb1693aca1eabbf75/users/624824dec06f4e239921437e407361ea/roles/108991f8e3774559b4def1c3448e020b` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.506540 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca3efe-72a8-4399-bf93-5d89e283e8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcdc73c9e214c8bb1693aca1eabbf75, user_id=624824dec06f4e239921437e407361ea, role_id=108991f8e3774559b4def1c3448e020b)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.509123 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca3efe-72a8-4399-bf93-5d89e283e8b1 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.516905 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.518481 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.519631 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1439/2911] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:01 2022] PUT /identity/v3/projects/0dcdc73c9e214c8bb1693aca1eabbf75/users/624824dec06f4e239921437e407361ea/roles/108991f8e3774559b4def1c3448e020b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:27:01.529349 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1473/2912] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:27:01.530800 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.531096 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.531367 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.562666 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] MFA Rules not processed for user `624824dec06f4e239921437e407361ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:01.563945 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.595839 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.597334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.641062 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1440/2913] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:01.656378 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:01.658402 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.679328 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b1d10-0a3c-4d1b-afe4-cf9e7d8c393a service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.719369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6a30a-c3e7-4e1a-b6c7-7fb99bae4a2a None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:01.721434 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=100 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:01.723369 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.723976 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.724256 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.724527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.740869 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:01.741497 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:01.741796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:01.742061 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:01.743780 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:01.755528 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.757090 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.767336 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1474/2914] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:27:01.783528 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:01.784961 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:01.794085 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1441/2915] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:27:03.446987 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:03.448402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:03.460120 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bf357-8fa4-4b72-8c57-c13d0f2a7ebf service placement] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:03.464069 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:03.464661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:03.464935 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:03.465202 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:03.521885 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:03.523308 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:03.532492 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1475/2916] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:04.086221 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:04.095100 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477602f-d83f-4a51-8225-8e8f1ad5008f service cinder] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:04.098731 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076494c-c1ac-4d33-a205-cb5e1417d5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:04.099322 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076494c-c1ac-4d33-a205-cb5e1417d5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:04.099597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076494c-c1ac-4d33-a205-cb5e1417d5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:04.099866 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076494c-c1ac-4d33-a205-cb5e1417d5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:04.108852 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076494c-c1ac-4d33-a205-cb5e1417d5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:04.110325 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076494c-c1ac-4d33-a205-cb5e1417d5f5 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:04.119849 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1442/2917] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:07.987623 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:08.058364 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732ca9c-a1cb-4e4e-b339-d25bb579addd service cinder] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:08.062996 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:08.063694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:08.064034 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:08.064390 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] PATH_INFO: `/v3/users/9f06d9bafacc47029579682933a2f073` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:08.066156 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f06d9bafacc47029579682933a2f073)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:08.068111 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:08.117925 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f06d9bafacc47029579682933a2f073'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.118575 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f06d9bafacc47029579682933a2f073'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.130727 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f06d9bafacc47029579682933a2f073'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.137562 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f06d9bafacc47029579682933a2f073'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.138342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f06d9bafacc47029579682933a2f073'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.140117 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:08.157679 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1476/2918] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:27:07 2022] DELETE /identity/v3/users/9f06d9bafacc47029579682933a2f073 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:08.159543 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:08.160024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:08.160149 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:08.303615 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:08.305001 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:08.310250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:08.365482 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1443/2919] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:08.375226 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:08.376672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:08.432366 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c58d4-6546-48e2-9f94-f169e89ec83b admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:08.435895 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:08.436474 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:08.436753 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:08.437019 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:08.446122 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:08.447517 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:08.456626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1477/2920] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:08.718046 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:08.719825 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:08.735055 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63034a-cd6c-460b-a86d-b6863c7f2660 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:08.740632 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:08.741353 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:08.741735 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:08.742009 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] PATH_INFO: `/v3/projects/e4bd2a64569648c0ad6932f8dff9c8ea` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:08.743116 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bd2a64569648c0ad6932f8dff9c8ea)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:08.744995 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:08.798316 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bd2a64569648c0ad6932f8dff9c8ea', 'request_id': 'req-5746d682-4b83-40d0-8e9b-368bebc91f19'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.805656 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bd2a64569648c0ad6932f8dff9c8ea', 'request_id': 'req-5746d682-4b83-40d0-8e9b-368bebc91f19'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.811148 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bd2a64569648c0ad6932f8dff9c8ea', 'request_id': 'req-5746d682-4b83-40d0-8e9b-368bebc91f19'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.822377 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] The token cache is being invalidate because project e4bd2a64569648c0ad6932f8dff9c8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:27:08.822673 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.823323 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.825132 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1444/2921] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:27:08 2022] DELETE /identity/v3/projects/e4bd2a64569648c0ad6932f8dff9c8ea => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:08.829077 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:08.839204 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035451c5-6955-42a6-b9ca-07458315d6fe service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:08.898041 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:08.898672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:08.898946 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:08.899220 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] PATH_INFO: `/v3/users/3c3150f1eff8416cb556a7f844aa790c` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:08.900360 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3150f1eff8416cb556a7f844aa790c)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:08.902280 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:08.955114 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3150f1eff8416cb556a7f844aa790c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.955845 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3150f1eff8416cb556a7f844aa790c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.968588 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3150f1eff8416cb556a7f844aa790c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.975767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3150f1eff8416cb556a7f844aa790c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.976470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3150f1eff8416cb556a7f844aa790c'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:08.989907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1478/2922] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:27:08 2022] DELETE /identity/v3/users/3c3150f1eff8416cb556a7f844aa790c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:09.346366 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:09.356921 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:09.370434 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d682-4b83-40d0-8e9b-368bebc91f19 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:09.431960 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:09.432591 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:09.432865 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:09.433131 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] PATH_INFO: `/v3/projects/759b1ffb9eeb48078cdc410e2c23e471` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:09.434270 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759b1ffb9eeb48078cdc410e2c23e471)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:09.436176 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:09.473797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:09.484838 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759b1ffb9eeb48078cdc410e2c23e471', 'request_id': 'req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.492634 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759b1ffb9eeb48078cdc410e2c23e471', 'request_id': 'req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.498075 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759b1ffb9eeb48078cdc410e2c23e471', 'request_id': 'req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.509269 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] The token cache is being invalidate because project 759b1ffb9eeb48078cdc410e2c23e471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:27:09.509576 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.510203 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.511669 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1445/2923] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:27:09 2022] DELETE /identity/v3/projects/759b1ffb9eeb48078cdc410e2c23e471 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:09.515803 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:09.517216 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:09.530782 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630f78-c60a-442a-990a-a04a12fe1c22 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:09.539352 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:09.591796 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:09.592420 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:09.592694 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:09.592959 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] PATH_INFO: `/v3/users/624824dec06f4e239921437e407361ea` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:09.594342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=624824dec06f4e239921437e407361ea)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:09.596907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:09.641498 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624824dec06f4e239921437e407361ea'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.642173 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624824dec06f4e239921437e407361ea'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.654208 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624824dec06f4e239921437e407361ea'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.661735 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624824dec06f4e239921437e407361ea'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.662362 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-86960f1c-dc46-4558-9726-c6252f4d8c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624824dec06f4e239921437e407361ea'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:09.674739 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1479/2924] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:27:09 2022] DELETE /identity/v3/users/624824dec06f4e239921437e407361ea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:10.215678 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.217112 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:10.232913 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b0eb-0ff8-45ef-918b-d8c81b8f7661 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:10.296603 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:10.297157 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.297430 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.297725 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] PATH_INFO: `/v3/projects/0dcdc73c9e214c8bb1693aca1eabbf75` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.298853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dcdc73c9e214c8bb1693aca1eabbf75)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:10.300782 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:10.351846 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dcdc73c9e214c8bb1693aca1eabbf75', 'request_id': 'req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:10.361526 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dcdc73c9e214c8bb1693aca1eabbf75', 'request_id': 'req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:10.369428 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dcdc73c9e214c8bb1693aca1eabbf75', 'request_id': 'req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:10.384233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] The token cache is being invalidate because project 0dcdc73c9e214c8bb1693aca1eabbf75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:27:10.384597 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:10.385359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-5c51b798-6f4f-40a0-a90d-1cc23d55c6a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:10.387418 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1446/2925] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:27:10 2022] DELETE /identity/v3/projects/0dcdc73c9e214c8bb1693aca1eabbf75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:10.392263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b2fc-f62c-4923-a24b-15bc687c5265 None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.393363 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b2fc-f62c-4923-a24b-15bc687c5265 None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.393695 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b2fc-f62c-4923-a24b-15bc687c5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.415834 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-89d6b2fc-f62c-4923-a24b-15bc687c5265 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:10.417209 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-89d6b2fc-f62c-4923-a24b-15bc687c5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:10.486901 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1480/2926] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:10.494772 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ca38-8c5e-497f-a3a8-74f55e55ba3c None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.495105 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ca38-8c5e-497f-a3a8-74f55e55ba3c None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.495439 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ca38-8c5e-497f-a3a8-74f55e55ba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.516527 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-7aa1ca38-8c5e-497f-a3a8-74f55e55ba3c None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:10.518250 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-7aa1ca38-8c5e-497f-a3a8-74f55e55ba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:10.527160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1447/2927] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:10.531427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6b2fc-f62c-4923-a24b-15bc687c5265 None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.541555 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6b2fc-f62c-4923-a24b-15bc687c5265 None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:10.546274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:10.546919 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.547144 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.547415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.548086 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:27:10.548386 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:10.549995 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:10.561353 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1481/2928] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 30 04:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:27:10.565544 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ca38-8c5e-497f-a3a8-74f55e55ba3c None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.574569 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ca38-8c5e-497f-a3a8-74f55e55ba3c None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:10.579452 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:10.580064 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.580853 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.581118 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] PATH_INFO: `/v3/projects` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.581912 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:10.583658 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:10.610830 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1448/2929] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 30 04:27:10 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:10.615137 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.624900 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197dc1-1086-4e9f-887a-622bc6a43845 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:10.642426 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:10.686015 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:10.686638 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.686907 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.687177 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] PATH_INFO: `/v3/users` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.687792 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:10.690265 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:10.711452 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1482/2930] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 30 04:27:10 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:10.715594 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.726150 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f61c-0bbd-4e20-802f-09809a263fae admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:10.731359 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:10.731959 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.732233 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.732497 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.733160 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:10.734795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:10.744813 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1449/2931] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:10.748855 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.759274 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862550f-a3e2-4b2c-9f77-abcffaafc555 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:10.763899 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d985-2296-4926-9c9e-415dc1ff8f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:10.764483 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d985-2296-4926-9c9e-415dc1ff8f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.764765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d985-2296-4926-9c9e-415dc1ff8f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.765037 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d985-2296-4926-9c9e-415dc1ff8f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.765704 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d985-2296-4926-9c9e-415dc1ff8f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:10.767263 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d985-2296-4926-9c9e-415dc1ff8f57 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:10.777659 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1483/2932] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:10.781461 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.791441 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba022-3f53-4f72-a8b4-c4ad5ea50fd2 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:10.795880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:10.796504 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.796779 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.797124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] PATH_INFO: `/v3/projects/10d6d3eb3fc54f85825dc9bae7f535c2/users/4b629b4e32db4612966da98f64deb89d/roles/d42a0cb1e08a4202a168c7707fdef7fd` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.809692 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:10.812880 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d6d3eb3fc54f85825dc9bae7f535c2, user_id=4b629b4e32db4612966da98f64deb89d, role_id=d42a0cb1e08a4202a168c7707fdef7fd)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:10.816776 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:10.830007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1450/2933] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:10 2022] PUT /identity/v3/projects/10d6d3eb3fc54f85825dc9bae7f535c2/users/4b629b4e32db4612966da98f64deb89d/roles/d42a0cb1e08a4202a168c7707fdef7fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:27:10.841958 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0a53d-4570-4b1b-8e53-c4deca6459bf None None] REQUEST_METHOD: `POST` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:10.842288 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0a53d-4570-4b1b-8e53-c4deca6459bf None None] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:10.842597 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0a53d-4570-4b1b-8e53-c4deca6459bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:10.870626 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.auth.core [None req-abe0a53d-4570-4b1b-8e53-c4deca6459bf None None] MFA Rules not processed for user `4b629b4e32db4612966da98f64deb89d`. Rule list: `[]` (Enabled: `True`). {{(pid=81656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:10.871828 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-abe0a53d-4570-4b1b-8e53-c4deca6459bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:10.934744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1484/2934] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:10.945941 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:10.947616 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:11.004007 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ba0c-1d2b-4dba-b650-1a59a1582960 admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:11.007795 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750e053-f820-45f5-8218-024eeb2d0093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e017d6c128460eb8506dfb32697f74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:11.008416 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e053-f820-45f5-8218-024eeb2d0093 service cinder] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:11.008699 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e053-f820-45f5-8218-024eeb2d0093 service cinder] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:11.008993 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e053-f820-45f5-8218-024eeb2d0093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:11.017251 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750e053-f820-45f5-8218-024eeb2d0093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:11.018694 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750e053-f820-45f5-8218-024eeb2d0093 service cinder] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:11.027293 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1451/2935] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:20.931847 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:21.023333 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:21.062767 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0a53d-4570-4b1b-8e53-c4deca6459bf None None] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:21.123405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0a53d-4570-4b1b-8e53-c4deca6459bf None None] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:21.127858 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:21.128465 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:21.128742 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:21.129010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] PATH_INFO: `/v3/users/4b629b4e32db4612966da98f64deb89d` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:21.130124 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b629b4e32db4612966da98f64deb89d)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:21.132006 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:21.177671 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b629b4e32db4612966da98f64deb89d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.178334 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b629b4e32db4612966da98f64deb89d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.190829 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b629b4e32db4612966da98f64deb89d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.198021 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b629b4e32db4612966da98f64deb89d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.198765 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b629b4e32db4612966da98f64deb89d'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.211074 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1485/2936] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:27:21 2022] DELETE /identity/v3/users/4b629b4e32db4612966da98f64deb89d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:21.215514 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] REQUEST_METHOD: `POST` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:21.215798 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:21.216067 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:21.235139 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.auth.core [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] MFA Rules not processed for user `6cce99ec4d5640fbb0998973ffaa1781`. Rule list: `[]` (Enabled: `True`). {{(pid=81657) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:21.236328 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:21.293471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1452/2937] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 30 04:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:21.303213 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:21.304682 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:21.360680 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f43be-99e7-472e-87e5-ed621d256195 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:21.364268 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f520107f73aa48f791461922a3d6ec4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:21.364851 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:21.365133 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:21.365401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:21.374271 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:21.375669 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:21.385401 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1486/2938] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:21.654705 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:21.656155 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:21.668124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a294-f0ab-424b-a162-001f3a524a46 None None] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:21.672575 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:21.673200 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:21.673470 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:21.673764 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] PATH_INFO: `/v3/projects/10d6d3eb3fc54f85825dc9bae7f535c2` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:21.674884 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d6d3eb3fc54f85825dc9bae7f535c2)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:21.676752 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:21.723760 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d6d3eb3fc54f85825dc9bae7f535c2', 'request_id': 'req-9238633c-66d4-4b2d-8c68-56d704708a5a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.731180 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d6d3eb3fc54f85825dc9bae7f535c2', 'request_id': 'req-9238633c-66d4-4b2d-8c68-56d704708a5a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.736521 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d6d3eb3fc54f85825dc9bae7f535c2', 'request_id': 'req-9238633c-66d4-4b2d-8c68-56d704708a5a'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.747924 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] The token cache is being invalidate because project 10d6d3eb3fc54f85825dc9bae7f535c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:27:21.748231 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.748867 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:21.750446 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1453/2939] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:27:21 2022] DELETE /identity/v3/projects/10d6d3eb3fc54f85825dc9bae7f535c2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:27:31.380781 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:31.744868 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:27.030507 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:27.032279 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:27.114508 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03ad35-7b0a-47af-af08-12bd0c03ca4e service neutron] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:27.185342 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:27.187060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:27.187060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:27.187060 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:27.188402 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:27.203394 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:27.205080 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:27.228582 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1487/2940] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:29.402471 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:29.403905 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:29.420351 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238633c-66d4-4b2d-8c68-56d704708a5a admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:29.426142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8b82c351b9340ee88bbb4a9b490847f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:29.426771 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] REQUEST_METHOD: `GET` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:29.427032 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:29.427296 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:29.429073 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:29.442775 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:29.444396 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:29.455904 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1454/2941] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:36.962223 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:36.965438 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:37.034804 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72ab2-6a79-43e1-a57a-964fadc1f6b1 service nova] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:37.039219 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:37.039835 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:37.040109 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:37.040376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] PATH_INFO: `/v3/users/b6a1ffb6398348baaf6aa2669fcc18b3` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:37.041470 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a1ffb6398348baaf6aa2669fcc18b3)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:37.043408 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:37.071376 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:37.091427 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a1ffb6398348baaf6aa2669fcc18b3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.092099 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a1ffb6398348baaf6aa2669fcc18b3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.105082 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a1ffb6398348baaf6aa2669fcc18b3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.112224 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a1ffb6398348baaf6aa2669fcc18b3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.112957 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a1ffb6398348baaf6aa2669fcc18b3'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.127586 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1488/2942] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:28:36 2022] DELETE /identity/v3/users/b6a1ffb6398348baaf6aa2669fcc18b3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:28:37.302304 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:37.314785 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6a5c-927a-469b-9e5e-383a3db16f24 service nova] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:37.373621 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:37.374247 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:37.374524 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:37.374797 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] PATH_INFO: `/v3/projects/37c25b2d75d244e4ae4af89be38c5769` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:37.375935 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c25b2d75d244e4ae4af89be38c5769)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:37.377882 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:37.422426 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c25b2d75d244e4ae4af89be38c5769', 'request_id': 'req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.429171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c25b2d75d244e4ae4af89be38c5769', 'request_id': 'req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.435109 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c25b2d75d244e4ae4af89be38c5769', 'request_id': 'req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.446171 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] The token cache is being invalidate because project 37c25b2d75d244e4ae4af89be38c5769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:28:37.446454 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.447088 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.448566 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1455/2943] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:28:37 2022] DELETE /identity/v3/projects/37c25b2d75d244e4ae4af89be38c5769 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:28:37.453158 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:37.454592 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:37.467661 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1372e-fbe7-4b99-87d7-9734aee36c00 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:37.523192 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:37.523809 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:37.524084 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:37.524354 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] PATH_INFO: `/v3/users/63888524ccc24a8988830ccaecc58147` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:37.525495 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63888524ccc24a8988830ccaecc58147)` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:37.527405 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:37.572983 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63888524ccc24a8988830ccaecc58147'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.573672 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63888524ccc24a8988830ccaecc58147'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.585810 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63888524ccc24a8988830ccaecc58147'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.592744 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63888524ccc24a8988830ccaecc58147'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.593443 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.notifications [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63888524ccc24a8988830ccaecc58147'} {{(pid=81656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.607750 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1489/2944] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 30 04:28:37 2022] DELETE /identity/v3/users/63888524ccc24a8988830ccaecc58147 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:28:37.780850 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Authenticating user token {{(pid=81657) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:37.782531 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.fernet_utils [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81657) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:37.795642 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb70a02-fbf4-4a84-83ca-88dc1385fddb admin admin] Validating token access rules against request {{(pid=81657) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:37.853113 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cce99ec4d5640fbb0998973ffaa1781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182d1898255a432ebd2d97be00a98e9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81657) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:37.853769 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:37.854049 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:37.854321 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] PATH_INFO: `/v3/projects/cb5bfdd1a3ed4d81aefe982759bc047f` {{(pid=81657) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:37.856024 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5bfdd1a3ed4d81aefe982759bc047f)` {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:37.858004 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] RBAC: Authorization granted {{(pid=81657) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:37.881814 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:37.908988 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5bfdd1a3ed4d81aefe982759bc047f', 'request_id': 'req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.916339 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5bfdd1a3ed4d81aefe982759bc047f', 'request_id': 'req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.922557 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5bfdd1a3ed4d81aefe982759bc047f', 'request_id': 'req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985'} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.935142 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] The token cache is being invalidate because project cb5bfdd1a3ed4d81aefe982759bc047f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81657) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:28:37.935427 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.936124 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG keystone.notifications [None req-2e3d3e2b-8192-46a0-bf8e-63b482f4e985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81657) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:37.937902 dv-cinder-852208-11-smb devstack@keystone.service[81657]: [pid: 81657|app: 0|req: 1456/2945] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 30 04:28:37 2022] DELETE /identity/v3/projects/cb5bfdd1a3ed4d81aefe982759bc047f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:28:47.603655 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:DELETE=16,keystone:SELECT=72,keystone:INSERT=2 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:47.930714 dv-cinder-852208-11-smb devstack@keystone.service[81657]: DEBUG dbcounter [-] [81657] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:39.912010 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Authenticating user token {{(pid=81656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:39.913410 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:39.983259 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b865172-84f6-4dad-aaae-43d41aec9de1 admin admin] Validating token access rules against request {{(pid=81656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:40.040501 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aad972-40bf-4836-a179-d38cc653e016 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dabb17584f42bab408c14ef0b93858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65ad8fe9e8804d01bceafd4494b05952', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:40.041095 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad972-40bf-4836-a179-d38cc653e016 service placement] REQUEST_METHOD: `GET` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:40.041374 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad972-40bf-4836-a179-d38cc653e016 service placement] SCRIPT_NAME: `/identity` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:40.041676 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aad972-40bf-4836-a179-d38cc653e016 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:40.043413 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.fernet_utils [None req-82aad972-40bf-4836-a179-d38cc653e016 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:40.054415 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aad972-40bf-4836-a179-d38cc653e016 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:40.055975 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aad972-40bf-4836-a179-d38cc653e016 service placement] RBAC: Authorization granted {{(pid=81656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:40.065914 dv-cinder-852208-11-smb devstack@keystone.service[81656]: [pid: 81656|app: 0|req: 1490/2946] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:50.061705 dv-cinder-852208-11-smb devstack@keystone.service[81656]: DEBUG dbcounter [-] [81656] Writing DB stats keystone:SELECT=58 {{(pid=81656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}